-- Logs begin at Thu 2022-06-30 09:56:55 UTC, end at Thu 2022-06-30 11:07:11 UTC. -- Jun 30 10:31:30.859034 dv-cinder-822822-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 30 10:31:30.868195 dv-cinder-822822-2-smb devstack@keystone.service[86792]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 10:31:30 2022] *** Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: nodename: dv-cinder-822822-2-smb Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: machine: x86_64 Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: clock source: unix Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: pcre jit disabled Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: detected number of CPU cores: 4 Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: current working directory: / Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: detected binary path: /usr/bin/uwsgi-core Jun 30 10:31:30.870299 dv-cinder-822822-2-smb devstack@keystone.service[86792]: your processes number limit is 47680 Jun 30 10:31:30.870884 dv-cinder-822822-2-smb devstack@keystone.service[86792]: your memory page size is 4096 bytes Jun 30 10:31:30.870884 dv-cinder-822822-2-smb devstack@keystone.service[86792]: detected max file descriptor number: 2048 Jun 30 10:31:30.870884 dv-cinder-822822-2-smb devstack@keystone.service[86792]: lock engine: pthread robust mutexes Jun 30 10:31:30.870884 dv-cinder-822822-2-smb devstack@keystone.service[86792]: thunder lock: enabled Jun 30 10:31:30.870884 dv-cinder-822822-2-smb devstack@keystone.service[86792]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 30 10:31:30.870884 dv-cinder-822822-2-smb devstack@keystone.service[86792]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 10:31:30.914871 dv-cinder-822822-2-smb devstack@keystone.service[86792]: Python main interpreter initialized at 0x5595fc7b49c0 Jun 30 10:31:30.914871 dv-cinder-822822-2-smb devstack@keystone.service[86792]: python threads support enabled Jun 30 10:31:30.914871 dv-cinder-822822-2-smb devstack@keystone.service[86792]: your server socket listen backlog is limited to 100 connections Jun 30 10:31:30.914871 dv-cinder-822822-2-smb devstack@keystone.service[86792]: your mercy for graceful operations on workers is 90 seconds Jun 30 10:31:30.915197 dv-cinder-822822-2-smb devstack@keystone.service[86792]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 10:31:30.915298 dv-cinder-822822-2-smb devstack@keystone.service[86792]: *** Operational MODE: preforking *** Jun 30 10:31:30.915579 dv-cinder-822822-2-smb devstack@keystone.service[86792]: *** uWSGI is running in multiple interpreter mode *** Jun 30 10:31:30.915579 dv-cinder-822822-2-smb devstack@keystone.service[86792]: spawned uWSGI master process (pid: 86792) Jun 30 10:31:30.915783 dv-cinder-822822-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 30 10:31:30.917374 dv-cinder-822822-2-smb devstack@keystone.service[86792]: spawned uWSGI worker 1 (pid: 86803, cores: 1) Jun 30 10:31:30.917374 dv-cinder-822822-2-smb devstack@keystone.service[86792]: spawned uWSGI worker 2 (pid: 86804, cores: 1) Jun 30 10:31:30.917374 dv-cinder-822822-2-smb devstack@keystone.service[86792]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 10:31:36.398518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:31:36.398518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: from cryptography.utils import int_from_bytes Jun 30 10:31:36.399298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:31:36.399298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: from cryptography.utils import int_from_bytes Jun 30 10:31:36.399419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:31:36.399419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: from cryptography.utils import int_from_bytes Jun 30 10:31:36.399814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:31:36.399814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: from cryptography.utils import int_from_bytes Jun 30 10:31:36.447852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:31:36.448051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:31:36.448200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:31:36.448296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] command line args: [] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:31:36.448406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:31:36.448509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:31:36.448592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] command line args: [] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:31:36.448674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ================================================================================ {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:31:36.448867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:31:36.448950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] admin_token = **** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.449050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ================================================================================ {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:31:36.449163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] config_dir = [] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.449307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] admin_token = **** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.449395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.449524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] config_source = [] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.449599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] config_dir = [] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.449703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] debug = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.449780 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.449901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.450222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] config_source = [] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.450222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] debug = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.450418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.450526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.450657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.450764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.450857 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.450949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] list_limit = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451447 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] log_config_append = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] list_limit = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] log_config_append = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] log_dir = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.451956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] log_file = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] log_dir = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] log_file = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.452969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.453826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.454021 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.454118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.454281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.454368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.454517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.454592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.454768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.454853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.455014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.455089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.455260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.455380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.455540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.455764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.455948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] publish_errors = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.456023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.456180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.456265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] publish_errors = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.456409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.456489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.456589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.456665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.456819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.456902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.457053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.457140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.457286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] standard_threads = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.457363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.457533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.457625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] standard_threads = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.457745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.457833 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.457905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] use_journal = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] use_json = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] use_journal = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] use_stderr = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] use_json = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] use_syslog = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] use_stderr = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] use_syslog = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.458994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.459066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:31:36.459134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.459319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.459396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.459561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.459646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.459813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.459895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.460055 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.460129 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.460291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.460377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.460546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.460637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.460796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.460873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.461036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.461122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.461287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.461363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.461536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.461612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.461784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.461872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.462053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.462130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.462298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.462409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.462530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.462616 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.462775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.462858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.463008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.463083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.463250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.463332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.463502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.463577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.463745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.463821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.463983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.464067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.464222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.464298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.464480 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.464583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.464838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.464922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.465086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.465164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.465316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.465392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.465546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.465623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.465776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.465852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.466033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.466111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.466275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.466354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.466527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.466607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.466758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.466840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.466990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.467068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.467222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.467296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.467472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.467547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.467714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.467798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.467953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.468028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.468182 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.468258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.468417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.468500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.468651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.468727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.468881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.468967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.469112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.469180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.469342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.469409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.469573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.469639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.470474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.470593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.470593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.470740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.470831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.470921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.471065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.471150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.471296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.471379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.471531 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.471614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.471766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.471853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.472004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.472082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.472236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.472311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.472472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.472556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.472711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.472787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.472946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.473022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.473184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.473277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.473418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.473510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.473648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.473724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.473884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.473989 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.474144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.474221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.474382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.474458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.474614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.474693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.474853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.475026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.475142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.475218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.475340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.475427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.475575 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.475652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.475813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.475890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.476052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.476135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.476303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.476376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.476802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.476879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.477042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.477194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.477268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.477336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.477501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.477578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.477738 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.477823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.477997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.478080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.478234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.478310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.478472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.478567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.478709 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.478786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.478941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.479018 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.479176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.479254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.479410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.479488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.479646 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.479723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.479877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.479951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.480110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.480187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.480363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.480438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.480602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.480684 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.480834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.480911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.481069 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.481143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.481300 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.481375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.481536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.481615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.481768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.481845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.482018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.482098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.482251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.482330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.482480 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.482557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.482725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.482806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.482954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.483031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.483184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.483259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.483417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.483492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.483653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.483730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.483889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.483965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.484127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.484202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.484384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.484462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.484621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.484695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.484852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] auth.external = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.484929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.485082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.485170 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] auth.external = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.485314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.485389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.486164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.486256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.486398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] auth.password = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.486476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.486626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] auth.token = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.486705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] auth.password = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.486861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] auth.token = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.486937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.487092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.487168 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.487336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.487440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.487582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.487660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.487816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.487893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.488059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.488137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.488289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.488367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.488523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] credential.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.488600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.488759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] credential.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.488836 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.489004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.489087 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.489250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.489335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.489485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.489565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.489720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.489795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.489965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.490111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.490202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.490274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.490465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.490549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.490714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.490799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.490952 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.491029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.491207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.491286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.491467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.491616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.491727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.491804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.491966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.492042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.492221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.492311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.492455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] federation.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.492541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.492696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.492774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] federation.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.492931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.493015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.493176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.493253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.493405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.493483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.493638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.493722 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.493876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.493966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.494137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.494214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.494375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.494463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.494616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.494693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.494849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.494925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.495094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.495179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.495324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.495401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.495563 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.495640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.495807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.495891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.496042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.496120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.496277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.496360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.496514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.496601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.496747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.496824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.496978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.497054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.497217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.497304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.497465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.497541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.497697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.497781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.497927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.498034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.498178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.498257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.498411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.498489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.498655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.498739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.498901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.498980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.499150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.499239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.499392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.499475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.499735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.499858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.499858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.500000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.500108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.500192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.500339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.500429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.500576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.500667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.500806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.500897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.501058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.501148 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.501299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.501388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.501539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.501629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.501779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.501866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.502029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.502118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.502279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.502367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.502523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.502610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.502761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.502851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.503000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.503088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.503240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.503327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.503470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.503559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.503705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.503795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.503932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.504028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.504162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.504249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.504393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.504482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.504628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.504716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.504860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.504947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.505095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.505184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.505334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.505430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.505576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.505670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.505806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.505903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.506058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.506138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.506291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.506370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.506541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.506620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.506776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.506855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.507013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.507089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.507247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.507326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.507476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.507553 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.507706 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.507782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.507949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.508079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.508201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.508324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.508451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.508524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.508663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.508732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.508910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.508991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.509158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.509236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.509386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.509464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.509615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.509691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.509848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.509925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.523987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524616 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.524969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525325 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525819 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525888 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.525978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] resource.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.526984 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] resource.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.527965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] role.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] role.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] role.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528514 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] role.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.528941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.529902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.530997 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531283 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.531996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.532067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.532137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.532206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.532275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.532375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.532375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533087 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533226 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] token.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.533915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] token.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534568 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.534989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535065 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535407 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.535950 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.connection = **** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.connection = **** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.536929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.537897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.538972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:31:36.539109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:31:36.539109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:31:36.566337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.566566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.566648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.566793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.566878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.567080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.575196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.575464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.604460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.604688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.604777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.604986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.745901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.746550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.795152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.795387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.795754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.795994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.860587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.860815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.861035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.861253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.861335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.861468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.861571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.861682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.861764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.862086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.862315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.862535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.886664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.886859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.886944 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.887098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.887196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.887320 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.887402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.887540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.887622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.887753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.887844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.887965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.888047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.888582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.899826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.900352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.912501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.912732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.912957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.913059 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.913179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.913264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.913396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.913478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.913609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.913781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.913867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.914033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.914253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.914471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:31:36.931247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.931460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:31:36.931751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.931835 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.931965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:31:36.932061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:31:36.932237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.932318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.932492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:31:36.932573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.932744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.932835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.932999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.933081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.933252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.933506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.944386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.944660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.944925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.945182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.945265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.945461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.945730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.946037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.953458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:36.954964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:36.957347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:36.957624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.957902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.958208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.958290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:36.958483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.958584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.958740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.958823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.959004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.959086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.959273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.959364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.959538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.959620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.959807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.959889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.960069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.960152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.960338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.960608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.960875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.986743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.987601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.988345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:36.988621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.989215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:36.989496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.993838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:36.994137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.994529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.994765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:36.995044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:36.995437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.002375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.002611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.003258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.003540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.007153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.007436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.007735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.007994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.008077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.008263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.008359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.008531 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.008614 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.008797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.008879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.009060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.009144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.009344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.009612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.009875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.028270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.028547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.029144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.029419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.033338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.034137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.036961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.037251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.037766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.038083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.042393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.043212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.045975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.046831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.049622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.049920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.050226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.050513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.050595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.050802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.050885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.051074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.051167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.051364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.051659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.051938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.070683 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.070961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.071222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.071479 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.071573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.071763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.072030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.072292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.079928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.080743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.081618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.081886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.082489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.082766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.085180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.085461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.085740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.085955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.086040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.086241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.086336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.086523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.086819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.087102 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.099444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.099720 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.100003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.100279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.100421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.100557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.100671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.100958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.101237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.101772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.102326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.102625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.103302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.103608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.120560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.121401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.123834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.124701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.127677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.128588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.129404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.130337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.131037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.131312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.131664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.131970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.132257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.132539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.138951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.139932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.140543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.141533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.144316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.144610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.144997 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.145271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.145353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.145587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.145998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.146279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.154324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.154611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.154896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.155410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.155698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.155982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.162759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.163035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.163309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.163577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.163841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.163922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:31:37.164150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.164232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.164432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.164516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.164708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.164790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.164980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.165071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.165255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.165337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.165532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.165614 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.165792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.165883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.166076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.166159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.166335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.166441 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.166727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.166991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.167256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.167522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:31:37.204790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5595fc7b49c0 pid: 86804 (default app) Jun 30 10:31:37.206212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5595fc7b49c0 pid: 86803 (default app) Jun 30 10:31:37.208149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c533e3-c4cb-4e11-b51f-156e0c591156 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:37.208441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c533e3-c4cb-4e11-b51f-156e0c591156 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:37.208717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c533e3-c4cb-4e11-b51f-156e0c591156 None None] PATH_INFO: `/v3` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:37.212897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Thu Jun 30 10:31:37 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:45.825567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4959a-203d-4550-812f-500d6b502197 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:45.826152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4959a-203d-4550-812f-500d6b502197 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:45.826152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4959a-203d-4550-812f-500d6b502197 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:45.831126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:31:45.836466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:45.836906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:45.837022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:45.906756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: INFO dbcounter [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] Registered counter for database keystone Jun 30 10:31:45.927773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG oslo_db.sqlalchemy.engines [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:45.933923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writer thread running {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:46.108187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG passlib.handlers.bcrypt [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86804) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 10:31:46.108522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG passlib.handlers.bcrypt [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86804) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 10:31:46.162848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:46.164418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:46.284003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 10:31:46.487415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4959a-203d-4550-812f-500d6b502197 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:46.557175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: INFO dbcounter [None req-8af4959a-203d-4550-812f-500d6b502197 None None] Registered counter for database keystone Jun 30 10:31:46.577043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG oslo_db.sqlalchemy.engines [None req-8af4959a-203d-4550-812f-500d6b502197 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:31:46.583305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writer thread running {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:31:46.702188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4959a-203d-4550-812f-500d6b502197 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:46.706533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff773d0c-0729-4ab8-ac2d-ad3a7f6a246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:46.707195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773d0c-0729-4ab8-ac2d-ad3a7f6a246a admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:46.707488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773d0c-0729-4ab8-ac2d-ad3a7f6a246a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:46.707775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773d0c-0729-4ab8-ac2d-ad3a7f6a246a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:46.715917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff773d0c-0729-4ab8-ac2d-ad3a7f6a246a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:46.767688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ff773d0c-0729-4ab8-ac2d-ad3a7f6a246a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 10:31:46.767984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff773d0c-0729-4ab8-ac2d-ad3a7f6a246a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:46.777504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Jun 30 10:31:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 10:31:46.784019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:46.798838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f693b3d-8783-4e4f-b181-71afab72feea None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:46.803183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c8e8e-5a34-41c5-bcea-60a04269e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:46.804288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8e8e-5a34-41c5-bcea-60a04269e9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:46.804578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8e8e-5a34-41c5-bcea-60a04269e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:46.804854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8e8e-5a34-41c5-bcea-60a04269e9e0 admin admin] PATH_INFO: `/v3/projects/50d0b85329f04f0dbf62de05b9135235` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:46.808941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c8e8e-5a34-41c5-bcea-60a04269e9e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=50d0b85329f04f0dbf62de05b9135235)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:46.858551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: WARNING keystone.common.rbac_enforcer.enforcer [None req-995c8e8e-5a34-41c5-bcea-60a04269e9e0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 10:31:46.859085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c8e8e-5a34-41c5-bcea-60a04269e9e0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:46.863960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Thu Jun 30 10:31:46 2022] GET /identity/v3/projects/50d0b85329f04f0dbf62de05b9135235 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:48.843425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1632d-b311-4ec5-8de7-3137c5d77446 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:48.843969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1632d-b311-4ec5-8de7-3137c5d77446 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:48.844692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1632d-b311-4ec5-8de7-3137c5d77446 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:48.848650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:31:48.854191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd565d-f80c-40e9-8a49-6728b819bab6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:48.854604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd565d-f80c-40e9-8a49-6728b819bab6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:48.854771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd565d-f80c-40e9-8a49-6728b819bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:48.873317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-00dd565d-f80c-40e9-8a49-6728b819bab6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:48.874890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-00dd565d-f80c-40e9-8a49-6728b819bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:48.883568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 10:31:48.906366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1632d-b311-4ec5-8de7-3137c5d77446 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:48.918606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1632d-b311-4ec5-8de7-3137c5d77446 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:48.922850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8a832-0b0a-44c4-b09d-12a884926045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:48.923484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a832-0b0a-44c4-b09d-12a884926045 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:48.923769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a832-0b0a-44c4-b09d-12a884926045 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:48.924048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a832-0b0a-44c4-b09d-12a884926045 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:48.931618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8a832-0b0a-44c4-b09d-12a884926045 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:48.933375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8a832-0b0a-44c4-b09d-12a884926045 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:48.942599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Jun 30 10:31:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:31:48.947870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd565d-f80c-40e9-8a49-6728b819bab6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:48.957442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd565d-f80c-40e9-8a49-6728b819bab6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:48.961796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb56e6-cded-417a-a113-592ada7810e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:48.962688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb56e6-cded-417a-a113-592ada7810e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:48.962980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb56e6-cded-417a-a113-592ada7810e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:48.963261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb56e6-cded-417a-a113-592ada7810e0 admin admin] PATH_INFO: `/v3/users/2c6c1fd699164758801d4c68c84f57b9` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:48.964649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb56e6-cded-417a-a113-592ada7810e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=2c6c1fd699164758801d4c68c84f57b9)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:48.966527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb56e6-cded-417a-a113-592ada7810e0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:48.968086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Thu Jun 30 10:31:48 2022] GET /identity/v3/users/2c6c1fd699164758801d4c68c84f57b9 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:51.038479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6f9f-981f-410d-a508-db92f37e78c6 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.039004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6f9f-981f-410d-a508-db92f37e78c6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.039103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6f9f-981f-410d-a508-db92f37e78c6 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.040407 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:31:51.045432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce124e82-e2f6-4786-b172-dbd281081966 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.045844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce124e82-e2f6-4786-b172-dbd281081966 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.046042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce124e82-e2f6-4786-b172-dbd281081966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.062449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ce124e82-e2f6-4786-b172-dbd281081966 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:51.063633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ce124e82-e2f6-4786-b172-dbd281081966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:51.070060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ac427-405d-4f4c-87cb-80f8baa1b60e None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.070357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ac427-405d-4f4c-87cb-80f8baa1b60e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.070637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ac427-405d-4f4c-87cb-80f8baa1b60e None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.071982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:31:51.076940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec3536-0e2b-4f69-920d-1c46c9cf032e None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.077228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec3536-0e2b-4f69-920d-1c46c9cf032e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.077512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec3536-0e2b-4f69-920d-1c46c9cf032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.117769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG passlib.handlers.bcrypt [None req-2eec3536-0e2b-4f69-920d-1c46c9cf032e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86803) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 10:31:51.118232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG passlib.handlers.bcrypt [None req-2eec3536-0e2b-4f69-920d-1c46c9cf032e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86803) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 10:31:51.149277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:31:51.164149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2eec3536-0e2b-4f69-920d-1c46c9cf032e None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:51.165750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2eec3536-0e2b-4f69-920d-1c46c9cf032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:51.172119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce124e82-e2f6-4786-b172-dbd281081966 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:51.195803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:51.265368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:31:51.276711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce124e82-e2f6-4786-b172-dbd281081966 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:51.288061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec3536-0e2b-4f69-920d-1c46c9cf032e None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:51.309543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3549162-349d-43ad-a12b-b72271648349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:51.310387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549162-349d-43ad-a12b-b72271648349 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.310679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549162-349d-43ad-a12b-b72271648349 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.310965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549162-349d-43ad-a12b-b72271648349 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.323008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3549162-349d-43ad-a12b-b72271648349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-f3549162-349d-43ad-a12b-b72271648349 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:31:51.334759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:31:51.335737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:31:51.336546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:31:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:31:51.341650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3549162-349d-43ad-a12b-b72271648349 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:51.387147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec3536-0e2b-4f69-920d-1c46c9cf032e None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:51.389363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:51.424474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:51.425382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d944cc-c4ec-40c5-a1fa-0e947ec30418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:51.426312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d944cc-c4ec-40c5-a1fa-0e947ec30418 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.426616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d944cc-c4ec-40c5-a1fa-0e947ec30418 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.426902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d944cc-c4ec-40c5-a1fa-0e947ec30418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.443107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3549162-349d-43ad-a12b-b72271648349 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:51.477206 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075ebde-7e75-4711-84c1-39a0d08f0a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:51.477872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075ebde-7e75-4711-84c1-39a0d08f0a08 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.478190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075ebde-7e75-4711-84c1-39a0d08f0a08 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.478473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075ebde-7e75-4711-84c1-39a0d08f0a08 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.479226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075ebde-7e75-4711-84c1-39a0d08f0a08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:51.479539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075ebde-7e75-4711-84c1-39a0d08f0a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:51.481081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075ebde-7e75-4711-84c1-39a0d08f0a08 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:51.494278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:31:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:51.494936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d944cc-c4ec-40c5-a1fa-0e947ec30418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:51.496560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d944cc-c4ec-40c5-a1fa-0e947ec30418 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:51.499640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075ebde-7e75-4711-84c1-39a0d08f0a08 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:51.594400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:31:51.598222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075ebde-7e75-4711-84c1-39a0d08f0a08 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:51.599892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d944cc-c4ec-40c5-a1fa-0e947ec30418 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:51.602810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:51.633142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50dfea-d5d3-422a-9cc6-11fc8f9d5d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:51.634054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50dfea-d5d3-422a-9cc6-11fc8f9d5d80 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.634346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50dfea-d5d3-422a-9cc6-11fc8f9d5d80 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.634625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50dfea-d5d3-422a-9cc6-11fc8f9d5d80 None admin] PATH_INFO: `/v3/users/2c6c1fd699164758801d4c68c84f57b9` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.635839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50dfea-d5d3-422a-9cc6-11fc8f9d5d80 None admin] RBAC: Authorizing `identity:get_user(user_id=2c6c1fd699164758801d4c68c84f57b9)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:51.637315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50dfea-d5d3-422a-9cc6-11fc8f9d5d80 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:51.638975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:31:51 2022] GET /identity/v3/users/2c6c1fd699164758801d4c68c84f57b9 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:51.644204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50dfea-d5d3-422a-9cc6-11fc8f9d5d80 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:51.658183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:51.698432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d944cc-c4ec-40c5-a1fa-0e947ec30418 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:51.731315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61983bbc-32d8-4f9a-89ed-ed011c0fea98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:51.732110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61983bbc-32d8-4f9a-89ed-ed011c0fea98 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.732399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61983bbc-32d8-4f9a-89ed-ed011c0fea98 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.732681 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61983bbc-32d8-4f9a-89ed-ed011c0fea98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.742390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50dfea-d5d3-422a-9cc6-11fc8f9d5d80 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:51.752018 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61983bbc-32d8-4f9a-89ed-ed011c0fea98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:51.753507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61983bbc-32d8-4f9a-89ed-ed011c0fea98 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-61983bbc-32d8-4f9a-89ed-ed011c0fea98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:31:51.775748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:31:51.776643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:31:51.777436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:31:51.777436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:31:51.777436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:31:51.777436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:31:51.777436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:31:51.777714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f712d9-820a-4502-9b20-eeff3fa3581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:51.777955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f712d9-820a-4502-9b20-eeff3fa3581d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.778239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f712d9-820a-4502-9b20-eeff3fa3581d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.778518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f712d9-820a-4502-9b20-eeff3fa3581d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.779712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f712d9-820a-4502-9b20-eeff3fa3581d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:51.781168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f712d9-820a-4502-9b20-eeff3fa3581d None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:51.782804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:31:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:51.782926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61983bbc-32d8-4f9a-89ed-ed011c0fea98 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:51.788189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f712d9-820a-4502-9b20-eeff3fa3581d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:51.839159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:51.867762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:51.883673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61983bbc-32d8-4f9a-89ed-ed011c0fea98 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:51.887049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f712d9-820a-4502-9b20-eeff3fa3581d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:51.918973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1f579-822a-41ad-a329-333ef2544db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:51.919645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1f579-822a-41ad-a329-333ef2544db5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.919939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1f579-822a-41ad-a329-333ef2544db5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.920224 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1f579-822a-41ad-a329-333ef2544db5 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.920961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1f579-822a-41ad-a329-333ef2544db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:51.921275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1f579-822a-41ad-a329-333ef2544db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:51.923255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1f579-822a-41ad-a329-333ef2544db5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:51.923546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6ea2-7617-44a7-8fca-f1adb7d9642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:51.924206 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6ea2-7617-44a7-8fca-f1adb7d9642b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:51.924494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6ea2-7617-44a7-8fca-f1adb7d9642b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:51.924871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6ea2-7617-44a7-8fca-f1adb7d9642b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:51.925611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6ea2-7617-44a7-8fca-f1adb7d9642b None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.domain.id=default, user.id=2c6c1fd699164758801d4c68c84f57b9) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:51.925927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6ea2-7617-44a7-8fca-f1adb7d9642b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:51.927392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6ea2-7617-44a7-8fca-f1adb7d9642b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:51.934002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Jun 30 10:31:51 2022] GET /identity/v3/role_assignments?user.id=2c6c1fd699164758801d4c68c84f57b9&scope.domain.id=default&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:51.941398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:54.211468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e754b-8854-4736-a2c0-0374cb2f915a None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.212454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e754b-8854-4736-a2c0-0374cb2f915a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.212939 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e754b-8854-4736-a2c0-0374cb2f915a None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.214539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:31:54.220476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d21c4-69fa-4d85-b584-6ac385aa9c91 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.220895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d21c4-69fa-4d85-b584-6ac385aa9c91 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.221038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d21c4-69fa-4d85-b584-6ac385aa9c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.247134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e91d21c4-69fa-4d85-b584-6ac385aa9c91 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:54.248572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e91d21c4-69fa-4d85-b584-6ac385aa9c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:54.330073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:31:54.365416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e754b-8854-4736-a2c0-0374cb2f915a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:54.514852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e754b-8854-4736-a2c0-0374cb2f915a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:54.518308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f74ce1-dcf7-4005-84a8-c0890a5f8718 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.518828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f74ce1-dcf7-4005-84a8-c0890a5f8718 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.519328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f74ce1-dcf7-4005-84a8-c0890a5f8718 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.522535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:31:54.524826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a461bf-7d3d-46e9-b1a4-95f5f5d1a8f9 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.524826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a461bf-7d3d-46e9-b1a4-95f5f5d1a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.524826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a461bf-7d3d-46e9-b1a4-95f5f5d1a8f9 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.525922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 13/25] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:31:54.531820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9433a0-de91-4ab7-a6ce-eed8bbbc073a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.532128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9433a0-de91-4ab7-a6ce-eed8bbbc073a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.532579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9433a0-de91-4ab7-a6ce-eed8bbbc073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.551639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ad9433a0-de91-4ab7-a6ce-eed8bbbc073a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:54.553014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ad9433a0-de91-4ab7-a6ce-eed8bbbc073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:54.571824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3185c-2928-4aa4-a110-aa7a2abdb18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:54.572640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3185c-2928-4aa4-a110-aa7a2abdb18e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.572931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3185c-2928-4aa4-a110-aa7a2abdb18e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.573212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3185c-2928-4aa4-a110-aa7a2abdb18e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.602852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3185c-2928-4aa4-a110-aa7a2abdb18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:31:54.604256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-fff3185c-2928-4aa4-a110-aa7a2abdb18e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:31:54.616425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:31:54.617317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:31:54.618508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 13/26] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:31:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:31:54.619140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e7b50-e462-44ec-8fac-61b44214b539 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.619210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e7b50-e462-44ec-8fac-61b44214b539 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.619509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e7b50-e462-44ec-8fac-61b44214b539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.629261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:31:54.630327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9433a0-de91-4ab7-a6ce-eed8bbbc073a None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:54.646316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:54.655147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-5f3e7b50-e462-44ec-8fac-61b44214b539 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:54.657006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5f3e7b50-e462-44ec-8fac-61b44214b539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:54.740575 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9433a0-de91-4ab7-a6ce-eed8bbbc073a None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:54.775851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5f857-26e7-4ab5-8e1c-8925528f683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:54.776917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5f857-26e7-4ab5-8e1c-8925528f683e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.777401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5f857-26e7-4ab5-8e1c-8925528f683e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.777886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5f857-26e7-4ab5-8e1c-8925528f683e None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.778911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5f857-26e7-4ab5-8e1c-8925528f683e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:54.779437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5f857-26e7-4ab5-8e1c-8925528f683e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:54.781167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5f857-26e7-4ab5-8e1c-8925528f683e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:54.795482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 15/28] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:31:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:54.796626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5f857-26e7-4ab5-8e1c-8925528f683e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:54.848475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:54.859849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 14/29] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:31:54.860720 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e7b50-e462-44ec-8fac-61b44214b539 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:54.901401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5f857-26e7-4ab5-8e1c-8925528f683e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:54.971703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4100b0-8db0-4afd-be6f-9ff3d9f7b967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:54.972413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4100b0-8db0-4afd-be6f-9ff3d9f7b967 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.972705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4100b0-8db0-4afd-be6f-9ff3d9f7b967 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.972985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4100b0-8db0-4afd-be6f-9ff3d9f7b967 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.973750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4100b0-8db0-4afd-be6f-9ff3d9f7b967 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:54.975324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4100b0-8db0-4afd-be6f-9ff3d9f7b967 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:55.017034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e7b50-e462-44ec-8fac-61b44214b539 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:55.052861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c818d33-99b1-4a99-93a7-b021edc9cde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:55.054101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818d33-99b1-4a99-93a7-b021edc9cde2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.054700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818d33-99b1-4a99-93a7-b021edc9cde2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.055167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818d33-99b1-4a99-93a7-b021edc9cde2 None admin] PATH_INFO: `/v3/users/2c6c1fd699164758801d4c68c84f57b9` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.056586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c818d33-99b1-4a99-93a7-b021edc9cde2 None admin] RBAC: Authorizing `identity:get_user(user_id=2c6c1fd699164758801d4c68c84f57b9)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:55.058331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c818d33-99b1-4a99-93a7-b021edc9cde2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:55.060146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 15/30] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:31:54 2022] GET /identity/v3/users/2c6c1fd699164758801d4c68c84f57b9 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:55.060913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c818d33-99b1-4a99-93a7-b021edc9cde2 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:55.063785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:55.167332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c818d33-99b1-4a99-93a7-b021edc9cde2 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:55.227097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2310-c19a-4a4e-9da1-ac035895d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:55.228730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2310-c19a-4a4e-9da1-ac035895d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.229217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2310-c19a-4a4e-9da1-ac035895d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.229714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2310-c19a-4a4e-9da1-ac035895d6f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.237623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 16/31] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 10:31:54 2022] POST /identity/v3/roles => generated 219 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:31:55.243091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f2310-c19a-4a4e-9da1-ac035895d6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:55.244940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f2310-c19a-4a4e-9da1-ac035895d6f6 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:55.246961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4100b0-8db0-4afd-be6f-9ff3d9f7b967 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-5d4f2310-c19a-4a4e-9da1-ac035895d6f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:31:55.266516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:31:55.267383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:31:55.268162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:31:55.268162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:31:55.268162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:31:55.268162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:31:55.270222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:31:55.277814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2310-c19a-4a4e-9da1-ac035895d6f6 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:55.397063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:55.412246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:55.420695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4100b0-8db0-4afd-be6f-9ff3d9f7b967 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:55.483898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2310-c19a-4a4e-9da1-ac035895d6f6 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:55.491701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a055773-4f35-4fe4-9061-66666ccb19d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:55.492745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a055773-4f35-4fe4-9061-66666ccb19d2 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.492943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a055773-4f35-4fe4-9061-66666ccb19d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.493194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a055773-4f35-4fe4-9061-66666ccb19d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.494899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a055773-4f35-4fe4-9061-66666ccb19d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:55.496589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a055773-4f35-4fe4-9061-66666ccb19d2 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:55.498390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:31:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:55.499794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be1bb7-4601-4999-b563-0854a6a954b1 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.500095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be1bb7-4601-4999-b563-0854a6a954b1 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.500376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be1bb7-4601-4999-b563-0854a6a954b1 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.501746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 18/34] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:31:55.507211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be1bb7-4601-4999-b563-0854a6a954b1 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:55.526727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acd0d9-bdf3-47b2-9ed1-7a4ac70ccada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:55.527833 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acd0d9-bdf3-47b2-9ed1-7a4ac70ccada None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.528435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acd0d9-bdf3-47b2-9ed1-7a4ac70ccada None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.528911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acd0d9-bdf3-47b2-9ed1-7a4ac70ccada None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.529887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acd0d9-bdf3-47b2-9ed1-7a4ac70ccada None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:55.530365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acd0d9-bdf3-47b2-9ed1-7a4ac70ccada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:55.532574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acd0d9-bdf3-47b2-9ed1-7a4ac70ccada None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:55.553977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 17/35] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:55.555529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0c53f-0252-4a19-8dca-252ed823007b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.555966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0c53f-0252-4a19-8dca-252ed823007b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.556464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0c53f-0252-4a19-8dca-252ed823007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.575381 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-e8d0c53f-0252-4a19-8dca-252ed823007b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:55.576897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e8d0c53f-0252-4a19-8dca-252ed823007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:55.625595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be1bb7-4601-4999-b563-0854a6a954b1 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:55.662711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 18/36] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:31:55.668938 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0c53f-0252-4a19-8dca-252ed823007b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:55.674744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6801cad-6220-41b6-92d7-484b1688e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:55.675765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801cad-6220-41b6-92d7-484b1688e24c None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.676053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801cad-6220-41b6-92d7-484b1688e24c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.676388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801cad-6220-41b6-92d7-484b1688e24c None admin] PATH_INFO: `/v3/domains/default/users/2c6c1fd699164758801d4c68c84f57b9/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.679120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6801cad-6220-41b6-92d7-484b1688e24c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2c6c1fd699164758801d4c68c84f57b9, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:55.680584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6801cad-6220-41b6-92d7-484b1688e24c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:55.710568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:55.763113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0c53f-0252-4a19-8dca-252ed823007b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:55.780974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 19/37] 10.222.0.26 () {58 vars in 1361 bytes} [Thu Jun 30 10:31:55 2022] PUT /identity/v3/domains/default/users/2c6c1fd699164758801d4c68c84f57b9/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:31:55.782499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a65db0-4391-4540-8c73-fcaae1f38f6f None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.782818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a65db0-4391-4540-8c73-fcaae1f38f6f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.783081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a65db0-4391-4540-8c73-fcaae1f38f6f None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.784579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 20/38] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:31:55.789594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a65db0-4391-4540-8c73-fcaae1f38f6f None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:55.811668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e560a38-7471-4fef-bb98-ddae464644c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:55.813359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e560a38-7471-4fef-bb98-ddae464644c1 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.813651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e560a38-7471-4fef-bb98-ddae464644c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.813931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e560a38-7471-4fef-bb98-ddae464644c1 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.814992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e560a38-7471-4fef-bb98-ddae464644c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:55.817447 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e560a38-7471-4fef-bb98-ddae464644c1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:55.832460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:55.920570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a65db0-4391-4540-8c73-fcaae1f38f6f None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:55.961075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3851f-ce43-4667-a5b7-43fa5fd57c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:55.962176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3851f-ce43-4667-a5b7-43fa5fd57c39 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.962632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3851f-ce43-4667-a5b7-43fa5fd57c39 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.963524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3851f-ce43-4667-a5b7-43fa5fd57c39 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.964286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3851f-ce43-4667-a5b7-43fa5fd57c39 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:55.965689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3851f-ce43-4667-a5b7-43fa5fd57c39 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:56.025821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 21/39] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 10:31:55 2022] POST /identity/v3/roles => generated 225 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:31:56.027267 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcbac1-6115-44d3-a1fc-99feea674a27 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:56.027571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcbac1-6115-44d3-a1fc-99feea674a27 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:56.027860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcbac1-6115-44d3-a1fc-99feea674a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:56.053185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a7fcbac1-6115-44d3-a1fc-99feea674a27 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:56.054820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a7fcbac1-6115-44d3-a1fc-99feea674a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:56.055162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 19/40] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:31:55 2022] POST /identity/v3/projects => generated 301 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:31:56.056746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e7120-af0a-4d34-9e55-261c9fd36522 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:56.057047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e7120-af0a-4d34-9e55-261c9fd36522 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:56.057350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e7120-af0a-4d34-9e55-261c9fd36522 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:56.058874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 20/41] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:31:56.064989 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129df9-ef86-4bbc-bbe2-935c87607a85 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:56.065368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129df9-ef86-4bbc-bbe2-935c87607a85 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:56.065729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129df9-ef86-4bbc-bbe2-935c87607a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:56.155753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:31:56.196146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcbac1-6115-44d3-a1fc-99feea674a27 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:56.199927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-44129df9-ef86-4bbc-bbe2-935c87607a85 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:56.201642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-44129df9-ef86-4bbc-bbe2-935c87607a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:56.231518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:56.304183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:31:56.329663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44129df9-ef86-4bbc-bbe2-935c87607a85 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:56.352058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcbac1-6115-44d3-a1fc-99feea674a27 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:56.365566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:56.401050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dd2f9-a560-4af7-8ead-88757cfa9565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:56.401868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dd2f9-a560-4af7-8ead-88757cfa9565 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:56.402189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dd2f9-a560-4af7-8ead-88757cfa9565 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:56.402477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dd2f9-a560-4af7-8ead-88757cfa9565 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:56.404334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dd2f9-a560-4af7-8ead-88757cfa9565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:56.405785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dd2f9-a560-4af7-8ead-88757cfa9565 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:56.408011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 23/44] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:31:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:56.414032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dd2f9-a560-4af7-8ead-88757cfa9565 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:56.449685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44129df9-ef86-4bbc-bbe2-935c87607a85 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:56.487623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebe1cc-42c7-4cc8-9d95-06b414ee592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:56.488294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebe1cc-42c7-4cc8-9d95-06b414ee592c None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:56.488587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebe1cc-42c7-4cc8-9d95-06b414ee592c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:56.488874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebe1cc-42c7-4cc8-9d95-06b414ee592c None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:56.489644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebe1cc-42c7-4cc8-9d95-06b414ee592c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:56.491208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebe1cc-42c7-4cc8-9d95-06b414ee592c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:56.504428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:56.519814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dd2f9-a560-4af7-8ead-88757cfa9565 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:56.552992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff782c6-0bda-4611-a3e8-1e423b8edf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:56.553656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff782c6-0bda-4611-a3e8-1e423b8edf62 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:56.553961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff782c6-0bda-4611-a3e8-1e423b8edf62 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:56.554256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff782c6-0bda-4611-a3e8-1e423b8edf62 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:56.558014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff782c6-0bda-4611-a3e8-1e423b8edf62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:56.558014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff782c6-0bda-4611-a3e8-1e423b8edf62 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:56.579841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 10:31:56 2022] POST /identity/v3/roles => generated 223 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:31:56.657977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:31:56 2022] POST /identity/v3/projects => generated 312 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:31:57.886686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f11d-5f46-448f-b9be-6196d827ca77 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:57.887230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f11d-5f46-448f-b9be-6196d827ca77 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:57.887230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f11d-5f46-448f-b9be-6196d827ca77 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:57.888796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:31:57.894261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75c79b-fa88-4b05-ad0d-5e30da6d9236 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:57.894656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75c79b-fa88-4b05-ad0d-5e30da6d9236 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:57.894844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75c79b-fa88-4b05-ad0d-5e30da6d9236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:57.911892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4e75c79b-fa88-4b05-ad0d-5e30da6d9236 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:57.913089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4e75c79b-fa88-4b05-ad0d-5e30da6d9236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:57.977895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:31:58.001567 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f11d-5f46-448f-b9be-6196d827ca77 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:58.086775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:58.102831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f11d-5f46-448f-b9be-6196d827ca77 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:58.136522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263de75-b3ec-44ad-8ca9-a93c4d7ddb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:58.137367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263de75-b3ec-44ad-8ca9-a93c4d7ddb73 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:58.137613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263de75-b3ec-44ad-8ca9-a93c4d7ddb73 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:58.137919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263de75-b3ec-44ad-8ca9-a93c4d7ddb73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:58.148018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263de75-b3ec-44ad-8ca9-a93c4d7ddb73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-a263de75-b3ec-44ad-8ca9-a93c4d7ddb73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:31:58.156497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:31:58.157326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:31:58.158105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 24/49] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:31:58.163973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75c79b-fa88-4b05-ad0d-5e30da6d9236 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:58.227091 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:58.260596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75c79b-fa88-4b05-ad0d-5e30da6d9236 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:58.294790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afb0c0-27f2-4118-8c80-49aff8718057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:58.295469 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afb0c0-27f2-4118-8c80-49aff8718057 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:58.295758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afb0c0-27f2-4118-8c80-49aff8718057 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:58.296039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afb0c0-27f2-4118-8c80-49aff8718057 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:58.296829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afb0c0-27f2-4118-8c80-49aff8718057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:58.297144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afb0c0-27f2-4118-8c80-49aff8718057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:58.298620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afb0c0-27f2-4118-8c80-49aff8718057 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:58.306648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 26/50] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:58.312258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263de75-b3ec-44ad-8ca9-a93c4d7ddb73 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:58.411408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263de75-b3ec-44ad-8ca9-a93c4d7ddb73 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:58.443641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e3ec3-0107-4069-ba13-4cb490f9030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:58.444517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e3ec3-0107-4069-ba13-4cb490f9030e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:58.444808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e3ec3-0107-4069-ba13-4cb490f9030e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:58.445092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e3ec3-0107-4069-ba13-4cb490f9030e None admin] PATH_INFO: `/v3/users/2c6c1fd699164758801d4c68c84f57b9` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:58.446316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e3ec3-0107-4069-ba13-4cb490f9030e None admin] RBAC: Authorizing `identity:get_user(user_id=2c6c1fd699164758801d4c68c84f57b9)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:58.447796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e3ec3-0107-4069-ba13-4cb490f9030e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:58.449599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 25/51] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:31:58 2022] GET /identity/v3/users/2c6c1fd699164758801d4c68c84f57b9 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:58.455442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afb0c0-27f2-4118-8c80-49aff8718057 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:58.659172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afb0c0-27f2-4118-8c80-49aff8718057 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:58.665563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58828fa-feb0-4fb1-b9ae-f2b1b223ba86 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:58.665801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58828fa-feb0-4fb1-b9ae-f2b1b223ba86 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:58.666124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58828fa-feb0-4fb1-b9ae-f2b1b223ba86 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:58.667503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 26/52] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:31:58.672329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69e35-40d9-4427-99aa-c9972fbe05d2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:58.672631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69e35-40d9-4427-99aa-c9972fbe05d2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:58.672909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69e35-40d9-4427-99aa-c9972fbe05d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:58.684653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:58.689860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3fa69e35-40d9-4427-99aa-c9972fbe05d2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:58.692746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3fa69e35-40d9-4427-99aa-c9972fbe05d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:58.693030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd42bee-0a2d-4266-87ee-afe019c91ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:58.693838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd42bee-0a2d-4266-87ee-afe019c91ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:58.694160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd42bee-0a2d-4266-87ee-afe019c91ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:58.694448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd42bee-0a2d-4266-87ee-afe019c91ba8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:58.695642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd42bee-0a2d-4266-87ee-afe019c91ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:58.697096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd42bee-0a2d-4266-87ee-afe019c91ba8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:58.698752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:58.700547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:58.704969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd42bee-0a2d-4266-87ee-afe019c91ba8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:58.759912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 27/54] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:31:58.783101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69e35-40d9-4427-99aa-c9972fbe05d2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:58.805220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd42bee-0a2d-4266-87ee-afe019c91ba8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:58.841334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534546a-9944-4597-9480-7381088f1555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:58.842025 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534546a-9944-4597-9480-7381088f1555 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:58.842320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534546a-9944-4597-9480-7381088f1555 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:58.842610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534546a-9944-4597-9480-7381088f1555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:58.843522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534546a-9944-4597-9480-7381088f1555 None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.domain.id=default, user.id=2c6c1fd699164758801d4c68c84f57b9) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:58.843901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534546a-9944-4597-9480-7381088f1555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:58.845402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534546a-9944-4597-9480-7381088f1555 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:58.854387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Jun 30 10:31:58 2022] GET /identity/v3/role_assignments?user.id=2c6c1fd699164758801d4c68c84f57b9&scope.domain.id=default&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:58.894130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69e35-40d9-4427-99aa-c9972fbe05d2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:58.931070 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b561-96ec-4692-a9d1-bdbbeee50354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:58.931787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b561-96ec-4692-a9d1-bdbbeee50354 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:58.932075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b561-96ec-4692-a9d1-bdbbeee50354 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:58.932354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b561-96ec-4692-a9d1-bdbbeee50354 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:58.933570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88b561-96ec-4692-a9d1-bdbbeee50354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:58.935109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88b561-96ec-4692-a9d1-bdbbeee50354 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:58.936773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 28/56] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:31:58.943127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534546a-9944-4597-9480-7381088f1555 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:59.006523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:59.047803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534546a-9944-4597-9480-7381088f1555 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:59.081349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed1a26-11aa-4da3-9d9d-d697133a180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:59.082043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed1a26-11aa-4da3-9d9d-d697133a180b None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:59.082334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed1a26-11aa-4da3-9d9d-d697133a180b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:59.082616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed1a26-11aa-4da3-9d9d-d697133a180b None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:59.083398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed1a26-11aa-4da3-9d9d-d697133a180b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:59.084849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed1a26-11aa-4da3-9d9d-d697133a180b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:59.163598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 29/57] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Jun 30 10:31:58 2022] POST /identity/v3/projects => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:01.173974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1f6ac-30c7-41ac-8c11-21658e3a8cc3 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:01.174462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1f6ac-30c7-41ac-8c11-21658e3a8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:01.174462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1f6ac-30c7-41ac-8c11-21658e3a8cc3 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:01.175822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:01.181108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245e329-c62f-41fd-9d45-3e5699646870 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:01.181466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245e329-c62f-41fd-9d45-3e5699646870 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:01.181689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245e329-c62f-41fd-9d45-3e5699646870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:01.198393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c245e329-c62f-41fd-9d45-3e5699646870 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:01.199597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c245e329-c62f-41fd-9d45-3e5699646870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:01.266117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:01.292270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1f6ac-30c7-41ac-8c11-21658e3a8cc3 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:01.307940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:01.397101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1f6ac-30c7-41ac-8c11-21658e3a8cc3 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:01.432108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba1317-d884-4362-bfde-c87380582a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:01.432823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1317-d884-4362-bfde-c87380582a1e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:01.433114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1317-d884-4362-bfde-c87380582a1e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:01.433395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1317-d884-4362-bfde-c87380582a1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:01.434584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba1317-d884-4362-bfde-c87380582a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:01.436056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba1317-d884-4362-bfde-c87380582a1e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:01.438302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:01.444074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245e329-c62f-41fd-9d45-3e5699646870 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:01.487543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:01.543153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245e329-c62f-41fd-9d45-3e5699646870 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:01.576940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01af3a4-3693-4255-8183-90faa37fc602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:01.577630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01af3a4-3693-4255-8183-90faa37fc602 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:01.577918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01af3a4-3693-4255-8183-90faa37fc602 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:01.578230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01af3a4-3693-4255-8183-90faa37fc602 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:01.578949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01af3a4-3693-4255-8183-90faa37fc602 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:01.580477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01af3a4-3693-4255-8183-90faa37fc602 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:01.716323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:01 2022] POST /identity/v3/users => generated 275 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:32:04.909973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffe086-01f4-4e6c-9ebc-f321809263a1 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:04.909973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffe086-01f4-4e6c-9ebc-f321809263a1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:04.909973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffe086-01f4-4e6c-9ebc-f321809263a1 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:04.911500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:04.916622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc34c6-f7ef-48a9-ac4b-df0b62f7a402 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:04.917401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc34c6-f7ef-48a9-ac4b-df0b62f7a402 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:04.917867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc34c6-f7ef-48a9-ac4b-df0b62f7a402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:04.942934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f4bc34c6-f7ef-48a9-ac4b-df0b62f7a402 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:04.944426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f4bc34c6-f7ef-48a9-ac4b-df0b62f7a402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:05.003852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9847a6-2a05-444d-88c6-310bfac6867b None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.004761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9847a6-2a05-444d-88c6-310bfac6867b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.005243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9847a6-2a05-444d-88c6-310bfac6867b None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.007167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:05.013457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafca3d-fe04-4584-9c80-76b3d59be274 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.013995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafca3d-fe04-4584-9c80-76b3d59be274 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.014488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafca3d-fe04-4584-9c80-76b3d59be274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.044371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:05.045400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-dfafca3d-fe04-4584-9c80-76b3d59be274 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:05.046957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-dfafca3d-fe04-4584-9c80-76b3d59be274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:05.078997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b5e6-e25b-4cc2-a4b7-1f5c2137be9d None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.079617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b5e6-e25b-4cc2-a4b7-1f5c2137be9d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.080099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b5e6-e25b-4cc2-a4b7-1f5c2137be9d None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.081689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 33/65] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:05.086640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb8e4-f29e-4ded-aa50-85151138b816 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.087145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb8e4-f29e-4ded-aa50-85151138b816 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.087435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb8e4-f29e-4ded-aa50-85151138b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.105197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4efeb8e4-f29e-4ded-aa50-85151138b816 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:05.106729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4efeb8e4-f29e-4ded-aa50-85151138b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:05.130230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.137039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 33/66] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:05.138794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafca3d-fe04-4584-9c80-76b3d59be274 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:05.153269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.183275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:05.184401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb8e4-f29e-4ded-aa50-85151138b816 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:05.283726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafca3d-fe04-4584-9c80-76b3d59be274 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:05.322604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446fd4c-32c1-48dd-b408-4d0a07a31525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:05.323645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446fd4c-32c1-48dd-b408-4d0a07a31525 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.323934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446fd4c-32c1-48dd-b408-4d0a07a31525 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.324215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446fd4c-32c1-48dd-b408-4d0a07a31525 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.330027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb8e4-f29e-4ded-aa50-85151138b816 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:05.335190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446fd4c-32c1-48dd-b408-4d0a07a31525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-6446fd4c-32c1-48dd-b408-4d0a07a31525 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:05.342894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:05.344259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:05.345015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 34/68] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:05.345629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446fd4c-32c1-48dd-b408-4d0a07a31525 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:05.368398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad539c3-e39f-477a-b887-69ef29ddef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:05.369322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad539c3-e39f-477a-b887-69ef29ddef35 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.369620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad539c3-e39f-477a-b887-69ef29ddef35 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.369903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad539c3-e39f-477a-b887-69ef29ddef35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.381472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad539c3-e39f-477a-b887-69ef29ddef35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-cad539c3-e39f-477a-b887-69ef29ddef35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:05.391446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:05.392523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:05.393384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:05.394447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2d41-e080-47fd-9270-b71383f7454c None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.394447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2d41-e080-47fd-9270-b71383f7454c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.394569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2d41-e080-47fd-9270-b71383f7454c None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.395893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 36/70] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:05.397923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2d41-e080-47fd-9270-b71383f7454c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:05.419027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.428696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.459935 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446fd4c-32c1-48dd-b408-4d0a07a31525 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:05.493272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35e5a3-d16a-4cde-a0b9-f57fd084b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:05.494096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35e5a3-d16a-4cde-a0b9-f57fd084b557 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.494394 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35e5a3-d16a-4cde-a0b9-f57fd084b557 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.494678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35e5a3-d16a-4cde-a0b9-f57fd084b557 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.504041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2d41-e080-47fd-9270-b71383f7454c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:05.505568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35e5a3-d16a-4cde-a0b9-f57fd084b557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-8e35e5a3-d16a-4cde-a0b9-f57fd084b557 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:05.513262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:05.514307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:05.521012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35e5a3-d16a-4cde-a0b9-f57fd084b557 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:05.545220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b8fae-b392-4ee2-bebe-53680cacd955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:05.545892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b8fae-b392-4ee2-bebe-53680cacd955 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.546251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b8fae-b392-4ee2-bebe-53680cacd955 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.546550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b8fae-b392-4ee2-bebe-53680cacd955 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.547305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b8fae-b392-4ee2-bebe-53680cacd955 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:05.547620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b8fae-b392-4ee2-bebe-53680cacd955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:05.549021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b8fae-b392-4ee2-bebe-53680cacd955 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:05.557452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 37/72] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:05.558685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17822-b40a-4919-81b0-45157459ad54 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.558978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17822-b40a-4919-81b0-45157459ad54 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.559261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17822-b40a-4919-81b0-45157459ad54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.579007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-aee17822-b40a-4919-81b0-45157459ad54 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:05.580955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-aee17822-b40a-4919-81b0-45157459ad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:05.619844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35e5a3-d16a-4cde-a0b9-f57fd084b557 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:05.645594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 38/73] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:05.646943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc7981-3d13-4705-a8db-d3cdf2cca21e None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.647236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc7981-3d13-4705-a8db-d3cdf2cca21e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.647518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc7981-3d13-4705-a8db-d3cdf2cca21e None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.648798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 39/74] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:05.649492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc7981-3d13-4705-a8db-d3cdf2cca21e None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:05.659131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991391-4c42-4e3b-aa88-5a008c275a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:05.659799 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991391-4c42-4e3b-aa88-5a008c275a4f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.660090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991391-4c42-4e3b-aa88-5a008c275a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.660374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991391-4c42-4e3b-aa88-5a008c275a4f None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.661125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991391-4c42-4e3b-aa88-5a008c275a4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:05.661438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991391-4c42-4e3b-aa88-5a008c275a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:05.663138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991391-4c42-4e3b-aa88-5a008c275a4f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:05.663570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.664523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.672401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 36/75] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:05.673106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991391-4c42-4e3b-aa88-5a008c275a4f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:05.759644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc7981-3d13-4705-a8db-d3cdf2cca21e None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:05.771241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991391-4c42-4e3b-aa88-5a008c275a4f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:05.793095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050622e-1b57-4b00-bd39-a176e13cfc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:05.793769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050622e-1b57-4b00-bd39-a176e13cfc22 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.794105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050622e-1b57-4b00-bd39-a176e13cfc22 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.794394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050622e-1b57-4b00-bd39-a176e13cfc22 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.795152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050622e-1b57-4b00-bd39-a176e13cfc22 None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:05.795469 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050622e-1b57-4b00-bd39-a176e13cfc22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:05.797375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050622e-1b57-4b00-bd39-a176e13cfc22 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:05.804249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6563a0-8e82-418b-a2d6-d8d5f15192fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:05.805111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6563a0-8e82-418b-a2d6-d8d5f15192fb None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.805257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 40/76] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:05.805405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6563a0-8e82-418b-a2d6-d8d5f15192fb None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.805666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6563a0-8e82-418b-a2d6-d8d5f15192fb None admin] PATH_INFO: `/v3/users/2c6c1fd699164758801d4c68c84f57b9` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.806523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb956c3-ece1-4b24-b7f3-d804ce61de0b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.806829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb956c3-ece1-4b24-b7f3-d804ce61de0b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.806915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6563a0-8e82-418b-a2d6-d8d5f15192fb None admin] RBAC: Authorizing `identity:get_user(user_id=2c6c1fd699164758801d4c68c84f57b9)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:05.807116 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb956c3-ece1-4b24-b7f3-d804ce61de0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.808342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6563a0-8e82-418b-a2d6-d8d5f15192fb None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:05.810114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 37/77] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/users/2c6c1fd699164758801d4c68c84f57b9 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:05.810861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6563a0-8e82-418b-a2d6-d8d5f15192fb None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:05.825959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-5eb956c3-ece1-4b24-b7f3-d804ce61de0b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:05.827146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-5eb956c3-ece1-4b24-b7f3-d804ce61de0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:05.869752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.900201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 41/78] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:05.901061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb956c3-ece1-4b24-b7f3-d804ce61de0b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:05.904323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.911417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6563a0-8e82-418b-a2d6-d8d5f15192fb None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:05.949375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af30514-f7e2-4614-b64e-91404cd6d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:05.950132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af30514-f7e2-4614-b64e-91404cd6d707 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.950429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af30514-f7e2-4614-b64e-91404cd6d707 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.950706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af30514-f7e2-4614-b64e-91404cd6d707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.951880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af30514-f7e2-4614-b64e-91404cd6d707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:05.953903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af30514-f7e2-4614-b64e-91404cd6d707 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:05.955539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 38/79] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:05.956293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af30514-f7e2-4614-b64e-91404cd6d707 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.007555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb956c3-ece1-4b24-b7f3-d804ce61de0b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:06.041015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8ccd0-791d-4a10-8b77-e31bbacb5c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:06.041881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8ccd0-791d-4a10-8b77-e31bbacb5c0b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.042195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8ccd0-791d-4a10-8b77-e31bbacb5c0b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.042475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8ccd0-791d-4a10-8b77-e31bbacb5c0b None admin] PATH_INFO: `/v3/users/5b58537fcdd84c4caaed986521aae14c` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.053461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af30514-f7e2-4614-b64e-91404cd6d707 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:06.057398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8ccd0-791d-4a10-8b77-e31bbacb5c0b None admin] RBAC: Authorizing `identity:get_user(user_id=5b58537fcdd84c4caaed986521aae14c)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:06.058890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8ccd0-791d-4a10-8b77-e31bbacb5c0b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:06.060690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 42/80] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/users/5b58537fcdd84c4caaed986521aae14c => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:06.061490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8ccd0-791d-4a10-8b77-e31bbacb5c0b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.080091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.087755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf39f-d30a-47c4-8386-a50b7be83940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:06.092199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf39f-d30a-47c4-8386-a50b7be83940 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.092199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf39f-d30a-47c4-8386-a50b7be83940 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.092199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf39f-d30a-47c4-8386-a50b7be83940 None admin] PATH_INFO: `/v3/users/5b58537fcdd84c4caaed986521aae14c` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.092199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcf39f-d30a-47c4-8386-a50b7be83940 None admin] RBAC: Authorizing `identity:get_user(user_id=5b58537fcdd84c4caaed986521aae14c)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:06.092199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcf39f-d30a-47c4-8386-a50b7be83940 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:06.094080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 39/81] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:05 2022] GET /identity/v3/users/5b58537fcdd84c4caaed986521aae14c => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:06.094849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf39f-d30a-47c4-8386-a50b7be83940 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.123506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.164500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8ccd0-791d-4a10-8b77-e31bbacb5c0b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:06.197230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf39f-d30a-47c4-8386-a50b7be83940 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:06.200609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd585c44-bcca-4e4f-a640-dbb5351e1ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:06.201292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585c44-bcca-4e4f-a640-dbb5351e1ace None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.201740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585c44-bcca-4e4f-a640-dbb5351e1ace None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.202308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585c44-bcca-4e4f-a640-dbb5351e1ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.249957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243adef-4688-4c42-abe3-7a1c1fce373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:06.251232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243adef-4688-4c42-abe3-7a1c1fce373c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.251719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243adef-4688-4c42-abe3-7a1c1fce373c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.252191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243adef-4688-4c42-abe3-7a1c1fce373c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.263549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243adef-4688-4c42-abe3-7a1c1fce373c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-d243adef-4688-4c42-abe3-7a1c1fce373c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:06.271810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:06.272831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:06.273617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 40/82] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:06.274292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243adef-4688-4c42-abe3-7a1c1fce373c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.292633 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd585c44-bcca-4e4f-a640-dbb5351e1ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:06.294170 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd585c44-bcca-4e4f-a640-dbb5351e1ace None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:06.328995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.351461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.372443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243adef-4688-4c42-abe3-7a1c1fce373c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:06.391708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 43/83] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:06.392538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd585c44-bcca-4e4f-a640-dbb5351e1ace None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.410893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f331e-ecdf-4c51-8cb9-dce34e4d1ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:06.411567 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f331e-ecdf-4c51-8cb9-dce34e4d1ff4 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.411859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f331e-ecdf-4c51-8cb9-dce34e4d1ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.412142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f331e-ecdf-4c51-8cb9-dce34e4d1ff4 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.412863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f331e-ecdf-4c51-8cb9-dce34e4d1ff4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:06.414364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f331e-ecdf-4c51-8cb9-dce34e4d1ff4 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:06.490246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd585c44-bcca-4e4f-a640-dbb5351e1ace None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:06.498440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 41/84] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:06 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:06.499866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f331e-ecdf-4c51-8cb9-dce34e4d1ff4 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.531617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032d4b-1d8e-4b11-8e4c-e93a2ab6867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:06.532299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032d4b-1d8e-4b11-8e4c-e93a2ab6867d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.532593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032d4b-1d8e-4b11-8e4c-e93a2ab6867d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.532871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032d4b-1d8e-4b11-8e4c-e93a2ab6867d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.571592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.618274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f331e-ecdf-4c51-8cb9-dce34e4d1ff4 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:06.618618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7032d4b-1d8e-4b11-8e4c-e93a2ab6867d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:06.620057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7032d4b-1d8e-4b11-8e4c-e93a2ab6867d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:06.635077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.659316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea059aa-8e17-4fcb-91c5-45d27915afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:06.660074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea059aa-8e17-4fcb-91c5-45d27915afc9 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.660376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea059aa-8e17-4fcb-91c5-45d27915afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.660663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea059aa-8e17-4fcb-91c5-45d27915afc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.736372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 44/85] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:06.737605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032d4b-1d8e-4b11-8e4c-e93a2ab6867d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.750148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea059aa-8e17-4fcb-91c5-45d27915afc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:06.751589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea059aa-8e17-4fcb-91c5-45d27915afc9 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:06.805774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.853359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032d4b-1d8e-4b11-8e4c-e93a2ab6867d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:06.875865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 42/86] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:06.876979 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea059aa-8e17-4fcb-91c5-45d27915afc9 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.897623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.904656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870198-b89c-4f2f-8279-0b63a6934b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:06.906501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870198-b89c-4f2f-8279-0b63a6934b0b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.907110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870198-b89c-4f2f-8279-0b63a6934b0b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.907560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870198-b89c-4f2f-8279-0b63a6934b0b None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.908799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870198-b89c-4f2f-8279-0b63a6934b0b None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:06.910113 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870198-b89c-4f2f-8279-0b63a6934b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:06.911482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870198-b89c-4f2f-8279-0b63a6934b0b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:06.923343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 45/87] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:06.924849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870198-b89c-4f2f-8279-0b63a6934b0b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.992636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea059aa-8e17-4fcb-91c5-45d27915afc9 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:07.029433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82407f6-6974-45b6-a3aa-2de6d8a3562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:07.030800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82407f6-6974-45b6-a3aa-2de6d8a3562d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:07.031100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82407f6-6974-45b6-a3aa-2de6d8a3562d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:07.031382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82407f6-6974-45b6-a3aa-2de6d8a3562d None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:07.032622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82407f6-6974-45b6-a3aa-2de6d8a3562d None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:07.034124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82407f6-6974-45b6-a3aa-2de6d8a3562d None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:07.035855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 43/88] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:06 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:07.036631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82407f6-6974-45b6-a3aa-2de6d8a3562d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:07.058838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870198-b89c-4f2f-8279-0b63a6934b0b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:07.083730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:07.099277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fb37b-67a8-44a7-a7a7-b0a2b4665b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:07.100158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fb37b-67a8-44a7-a7a7-b0a2b4665b84 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:07.100452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fb37b-67a8-44a7-a7a7-b0a2b4665b84 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:07.100996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fb37b-67a8-44a7-a7a7-b0a2b4665b84 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:07.102261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fb37b-67a8-44a7-a7a7-b0a2b4665b84 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:07.103741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fb37b-67a8-44a7-a7a7-b0a2b4665b84 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:07.110472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 46/89] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:06 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:07.111369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fb37b-67a8-44a7-a7a7-b0a2b4665b84 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:07.139471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:07.160326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82407f6-6974-45b6-a3aa-2de6d8a3562d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:07.199126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7579d-2b72-4d8a-a5d1-d65029199777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:07.200123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7579d-2b72-4d8a-a5d1-d65029199777 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:07.200417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7579d-2b72-4d8a-a5d1-d65029199777 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:07.200700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7579d-2b72-4d8a-a5d1-d65029199777 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:07.201924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7579d-2b72-4d8a-a5d1-d65029199777 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:07.203694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7579d-2b72-4d8a-a5d1-d65029199777 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:07.205704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 44/90] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:07 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:07.206517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7579d-2b72-4d8a-a5d1-d65029199777 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:07.224959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fb37b-67a8-44a7-a7a7-b0a2b4665b84 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:07.260065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a2c6-5200-4b3d-b04d-387a6ca9024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:07.261100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a2c6-5200-4b3d-b04d-387a6ca9024e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:07.261461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a2c6-5200-4b3d-b04d-387a6ca9024e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:07.261821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a2c6-5200-4b3d-b04d-387a6ca9024e None admin] PATH_INFO: `/v3/users/5b58537fcdd84c4caaed986521aae14c` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:07.263220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a2c6-5200-4b3d-b04d-387a6ca9024e None admin] RBAC: Authorizing `identity:get_user(user_id=5b58537fcdd84c4caaed986521aae14c)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:07.265349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a2c6-5200-4b3d-b04d-387a6ca9024e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:07.267184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 47/91] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:07 2022] GET /identity/v3/users/5b58537fcdd84c4caaed986521aae14c => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:07.272755 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a2c6-5200-4b3d-b04d-387a6ca9024e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:07.319942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7579d-2b72-4d8a-a5d1-d65029199777 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:07.338912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:07.358452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d49ff-cbf9-441b-b380-679489e4f485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:07.359436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d49ff-cbf9-441b-b380-679489e4f485 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:07.359925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d49ff-cbf9-441b-b380-679489e4f485 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:07.360434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d49ff-cbf9-441b-b380-679489e4f485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:07.361496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d49ff-cbf9-441b-b380-679489e4f485 None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998, user.id=2c6c1fd699164758801d4c68c84f57b9) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:07.362024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d49ff-cbf9-441b-b380-679489e4f485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:07.363670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d49ff-cbf9-441b-b380-679489e4f485 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:07.374477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 45/92] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:07 2022] GET /identity/v3/role_assignments?user.id=2c6c1fd699164758801d4c68c84f57b9&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:07.374477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d49ff-cbf9-441b-b380-679489e4f485 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:07.384851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a2c6-5200-4b3d-b04d-387a6ca9024e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:07.388537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:07.439810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831d2b-ef00-40ba-8cfb-83657521c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:07.440639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831d2b-ef00-40ba-8cfb-83657521c519 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:07.441004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831d2b-ef00-40ba-8cfb-83657521c519 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:07.441727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831d2b-ef00-40ba-8cfb-83657521c519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:07.442327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831d2b-ef00-40ba-8cfb-83657521c519 None admin] RBAC: Adding query filter params (role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998, user.id=5b58537fcdd84c4caaed986521aae14c) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:07.442712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831d2b-ef00-40ba-8cfb-83657521c519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:07.444308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831d2b-ef00-40ba-8cfb-83657521c519 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:07.458133 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 48/93] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:07 2022] GET /identity/v3/role_assignments?user.id=5b58537fcdd84c4caaed986521aae14c&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:07.459090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831d2b-ef00-40ba-8cfb-83657521c519 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:07.499053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d49ff-cbf9-441b-b380-679489e4f485 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:07.540155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bc33a-817a-4c71-ac09-0615ac61cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:07.541238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc33a-817a-4c71-ac09-0615ac61cc9a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:07.541756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc33a-817a-4c71-ac09-0615ac61cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:07.542271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc33a-817a-4c71-ac09-0615ac61cc9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:07.543363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bc33a-817a-4c71-ac09-0615ac61cc9a None admin] RBAC: Adding query filter params (role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998, user.id=5b58537fcdd84c4caaed986521aae14c) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:07.543906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bc33a-817a-4c71-ac09-0615ac61cc9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:07.545732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bc33a-817a-4c71-ac09-0615ac61cc9a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:07.552925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 46/94] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:07 2022] GET /identity/v3/role_assignments?user.id=5b58537fcdd84c4caaed986521aae14c&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:07.657530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831d2b-ef00-40ba-8cfb-83657521c519 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:07.683477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:07.697094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8e058-2a30-481c-b000-79dac370fcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:07.702791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8e058-2a30-481c-b000-79dac370fcd0 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:07.702791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8e058-2a30-481c-b000-79dac370fcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:07.702791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8e058-2a30-481c-b000-79dac370fcd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:07.776717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8e058-2a30-481c-b000-79dac370fcd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:07.778238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8e058-2a30-481c-b000-79dac370fcd0 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:07.894979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 49/95] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:07.901261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bc33a-817a-4c71-ac09-0615ac61cc9a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:08.019861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:08.043648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bc33a-817a-4c71-ac09-0615ac61cc9a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:08.087573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dde32-db64-43f9-b46f-232eb77094c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:08.088453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dde32-db64-43f9-b46f-232eb77094c0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:08.088749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dde32-db64-43f9-b46f-232eb77094c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:08.089040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dde32-db64-43f9-b46f-232eb77094c0 None admin] PATH_INFO: `/v3/projects/ea13c41bf1f7482489dc5306b616557f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:08.090281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dde32-db64-43f9-b46f-232eb77094c0 None admin] RBAC: Authorizing `identity:get_project(project_id=ea13c41bf1f7482489dc5306b616557f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:08.091756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dde32-db64-43f9-b46f-232eb77094c0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:08.093500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 47/96] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:07 2022] GET /identity/v3/projects/ea13c41bf1f7482489dc5306b616557f => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:08.099418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8e058-2a30-481c-b000-79dac370fcd0 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:08.135017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:08.231910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8e058-2a30-481c-b000-79dac370fcd0 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:08.272509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dca086-13fc-446e-bea4-c72014a08403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:08.273518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dca086-13fc-446e-bea4-c72014a08403 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:08.274064 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dca086-13fc-446e-bea4-c72014a08403 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:08.274554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dca086-13fc-446e-bea4-c72014a08403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:08.275624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dca086-13fc-446e-bea4-c72014a08403 None admin] RBAC: Adding query filter params (role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=ea13c41bf1f7482489dc5306b616557f, user.id=5b58537fcdd84c4caaed986521aae14c) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:08.276195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dca086-13fc-446e-bea4-c72014a08403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:08.277910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dca086-13fc-446e-bea4-c72014a08403 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:08.284577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 50/97] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:08 2022] GET /identity/v3/role_assignments?user.id=5b58537fcdd84c4caaed986521aae14c&scope.project.id=ea13c41bf1f7482489dc5306b616557f&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:09.360994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31509c8-e394-4c95-b785-80b4d2287241 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:09.361500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31509c8-e394-4c95-b785-80b4d2287241 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:09.361603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31509c8-e394-4c95-b785-80b4d2287241 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:09.363140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 48/98] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:09.368679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae177a-8cfe-43e3-a0ef-6a603903ee92 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:09.369599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae177a-8cfe-43e3-a0ef-6a603903ee92 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:09.370127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae177a-8cfe-43e3-a0ef-6a603903ee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:09.395013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-93ae177a-8cfe-43e3-a0ef-6a603903ee92 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:09.396546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-93ae177a-8cfe-43e3-a0ef-6a603903ee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:09.480605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 51/99] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:09.522264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31509c8-e394-4c95-b785-80b4d2287241 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:09.653847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31509c8-e394-4c95-b785-80b4d2287241 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:09.700733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb638-d162-468e-9e31-6dce8bcb1629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:09.701540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb638-d162-468e-9e31-6dce8bcb1629 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:09.701835 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb638-d162-468e-9e31-6dce8bcb1629 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:09.702678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb638-d162-468e-9e31-6dce8bcb1629 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:09.716097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcb638-d162-468e-9e31-6dce8bcb1629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-07fcb638-d162-468e-9e31-6dce8bcb1629 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:09.724477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:09.725298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:09.726354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 49/100] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:09.731835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae177a-8cfe-43e3-a0ef-6a603903ee92 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:09.761801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:09.794432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839df35-0ae1-4330-9e31-3a369ac64d46 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:09.794743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839df35-0ae1-4330-9e31-3a369ac64d46 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:09.795022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839df35-0ae1-4330-9e31-3a369ac64d46 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:09.796702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 50/101] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:09.817183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728bcdf-6d3a-4279-a9dc-313b9e6e4a05 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:09.817460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728bcdf-6d3a-4279-a9dc-313b9e6e4a05 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:09.817757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728bcdf-6d3a-4279-a9dc-313b9e6e4a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:09.831176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:09.850101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-8728bcdf-6d3a-4279-a9dc-313b9e6e4a05 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:09.851575 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8728bcdf-6d3a-4279-a9dc-313b9e6e4a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:09.948973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae177a-8cfe-43e3-a0ef-6a603903ee92 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:10.000370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 51/102] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:10.027267 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b099d-1354-436b-b267-e88b54d4538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:10.027960 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b099d-1354-436b-b267-e88b54d4538d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.028254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b099d-1354-436b-b267-e88b54d4538d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.028543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b099d-1354-436b-b267-e88b54d4538d None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.029324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b099d-1354-436b-b267-e88b54d4538d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:10.029643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b099d-1354-436b-b267-e88b54d4538d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:10.031122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b099d-1354-436b-b267-e88b54d4538d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:10.045594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 52/103] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:10.050025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728bcdf-6d3a-4279-a9dc-313b9e6e4a05 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:10.063913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b099d-1354-436b-b267-e88b54d4538d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:10.162500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728bcdf-6d3a-4279-a9dc-313b9e6e4a05 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:10.199862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ec0be-e7d9-480c-aa2c-afe052482e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:10.200578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ec0be-e7d9-480c-aa2c-afe052482e2b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.200867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ec0be-e7d9-480c-aa2c-afe052482e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.201144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ec0be-e7d9-480c-aa2c-afe052482e2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.205969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ec0be-e7d9-480c-aa2c-afe052482e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:10.205969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ec0be-e7d9-480c-aa2c-afe052482e2b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:10.206472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 52/104] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:10.211800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ec0be-e7d9-480c-aa2c-afe052482e2b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:10.215269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:10.247200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:10.296608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b099d-1354-436b-b267-e88b54d4538d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:10.324790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ec0be-e7d9-480c-aa2c-afe052482e2b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:10.362336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac952c80-368a-4795-9fc0-e80f0718ec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:10.363851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac952c80-368a-4795-9fc0-e80f0718ec5e None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.364455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac952c80-368a-4795-9fc0-e80f0718ec5e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.364981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac952c80-368a-4795-9fc0-e80f0718ec5e None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.365890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac952c80-368a-4795-9fc0-e80f0718ec5e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:10.367557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac952c80-368a-4795-9fc0-e80f0718ec5e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:10.381066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d762866-7680-4ea5-9635-7d460018b898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:10.381987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d762866-7680-4ea5-9635-7d460018b898 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.382285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d762866-7680-4ea5-9635-7d460018b898 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.382570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d762866-7680-4ea5-9635-7d460018b898 None admin] PATH_INFO: `/v3/users/f9cc542d589041849760cb3f5ac2c17c` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.396627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d762866-7680-4ea5-9635-7d460018b898 None admin] RBAC: Authorizing `identity:get_user(user_id=f9cc542d589041849760cb3f5ac2c17c)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:10.404134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d762866-7680-4ea5-9635-7d460018b898 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:10.404134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 53/105] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:10 2022] GET /identity/v3/users/f9cc542d589041849760cb3f5ac2c17c => generated 289 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:10.405618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d762866-7680-4ea5-9635-7d460018b898 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:10.480247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 53/106] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:32:10 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:10.481789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e1dca-0a46-48af-a35f-046e7b4d023b None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.482178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e1dca-0a46-48af-a35f-046e7b4d023b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.482565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e1dca-0a46-48af-a35f-046e7b4d023b None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.491408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 54/107] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:10.497431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465535-fc91-4d45-a423-6aab1f1d39d1 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.497652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465535-fc91-4d45-a423-6aab1f1d39d1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.498109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465535-fc91-4d45-a423-6aab1f1d39d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.519515 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d762866-7680-4ea5-9635-7d460018b898 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:10.531788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-04465535-fc91-4d45-a423-6aab1f1d39d1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:10.533088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-04465535-fc91-4d45-a423-6aab1f1d39d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:10.557103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340d73e-c405-4a41-b4ba-9c7528af8d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:10.558202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d73e-c405-4a41-b4ba-9c7528af8d67 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.558695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d73e-c405-4a41-b4ba-9c7528af8d67 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.559176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d73e-c405-4a41-b4ba-9c7528af8d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.564546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:10.627053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:10.636393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340d73e-c405-4a41-b4ba-9c7528af8d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:10.638252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340d73e-c405-4a41-b4ba-9c7528af8d67 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:10.657243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 55/108] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:10.658808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c17c-984b-456a-9efb-e4b574939d88 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.659102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c17c-984b-456a-9efb-e4b574939d88 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.659385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c17c-984b-456a-9efb-e4b574939d88 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.660951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 56/109] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:10.666366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64a4ac-16bd-48d5-a642-7bf5bf75c147 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.666680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64a4ac-16bd-48d5-a642-7bf5bf75c147 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.666964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64a4ac-16bd-48d5-a642-7bf5bf75c147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.688491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-bb64a4ac-16bd-48d5-a642-7bf5bf75c147 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:10.689719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bb64a4ac-16bd-48d5-a642-7bf5bf75c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:10.753750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 54/110] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:32:10.755422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6657ce-3af1-4955-b4b2-7ea9fa4159d1 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.755920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6657ce-3af1-4955-b4b2-7ea9fa4159d1 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.756651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6657ce-3af1-4955-b4b2-7ea9fa4159d1 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.758579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 55/111] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:10.759595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6657ce-3af1-4955-b4b2-7ea9fa4159d1 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:10.770498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 57/112] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:10.771295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64a4ac-16bd-48d5-a642-7bf5bf75c147 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:10.800337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:10.887765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6657ce-3af1-4955-b4b2-7ea9fa4159d1 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:10.915911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64a4ac-16bd-48d5-a642-7bf5bf75c147 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:10.930979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615977f-174e-4832-8a63-79d602e6abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:10.932293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615977f-174e-4832-8a63-79d602e6abba None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.932745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615977f-174e-4832-8a63-79d602e6abba None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.933167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615977f-174e-4832-8a63-79d602e6abba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.936495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:10.947580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615977f-174e-4832-8a63-79d602e6abba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-7615977f-174e-4832-8a63-79d602e6abba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:10.957737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:10.958624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:10.959388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 56/113] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:32:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:10.960896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ef04d-843f-4fb2-88e3-6034607868da None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.962488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eaab2-152c-4ed7-8943-6c046472b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:10.963659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eaab2-152c-4ed7-8943-6c046472b03e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:10.964216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eaab2-152c-4ed7-8943-6c046472b03e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.964710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eaab2-152c-4ed7-8943-6c046472b03e None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.965042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ef04d-843f-4fb2-88e3-6034607868da None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:10.965357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ef04d-843f-4fb2-88e3-6034607868da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:10.966646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eaab2-152c-4ed7-8943-6c046472b03e None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:10.969460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eaab2-152c-4ed7-8943-6c046472b03e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:10.971858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 58/114] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:10 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:10.973925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eaab2-152c-4ed7-8943-6c046472b03e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:10.990024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-472ef04d-843f-4fb2-88e3-6034607868da None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:10.991746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-472ef04d-843f-4fb2-88e3-6034607868da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:11.082234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 57/115] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:11.086868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ef04d-843f-4fb2-88e3-6034607868da None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:11.122072 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eaab2-152c-4ed7-8943-6c046472b03e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:11.126741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:11.171954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d7ece-bf9f-4cc3-9a5a-28cfee3bf782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:11.173047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d7ece-bf9f-4cc3-9a5a-28cfee3bf782 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.173343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d7ece-bf9f-4cc3-9a5a-28cfee3bf782 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.173629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d7ece-bf9f-4cc3-9a5a-28cfee3bf782 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.188647 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d7ece-bf9f-4cc3-9a5a-28cfee3bf782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-644d7ece-bf9f-4cc3-9a5a-28cfee3bf782 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:11.199051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:11.199946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:11.200711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 59/116] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:11.201334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d7ece-bf9f-4cc3-9a5a-28cfee3bf782 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:11.214427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ef04d-843f-4fb2-88e3-6034607868da None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:11.254524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:11.258959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c10b3-1397-4919-b8d3-85159323fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:11.265005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c10b3-1397-4919-b8d3-85159323fb8c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.265005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c10b3-1397-4919-b8d3-85159323fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.265005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c10b3-1397-4919-b8d3-85159323fb8c None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.265005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c10b3-1397-4919-b8d3-85159323fb8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:11.265005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c10b3-1397-4919-b8d3-85159323fb8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:11.265005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c10b3-1397-4919-b8d3-85159323fb8c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:11.271535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 58/117] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:11.275967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c10b3-1397-4919-b8d3-85159323fb8c None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:11.318290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d7ece-bf9f-4cc3-9a5a-28cfee3bf782 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:11.356353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7423f6b-06bc-43fb-a166-e5d918512d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:11.357248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7423f6b-06bc-43fb-a166-e5d918512d85 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.357550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7423f6b-06bc-43fb-a166-e5d918512d85 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.358014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7423f6b-06bc-43fb-a166-e5d918512d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.358894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7423f6b-06bc-43fb-a166-e5d918512d85 None admin] RBAC: Adding query filter params (role.id=cfb149781a404c6892fa0ff5b015482d, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998, user.id=f9cc542d589041849760cb3f5ac2c17c) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:11.359247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7423f6b-06bc-43fb-a166-e5d918512d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:11.360679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7423f6b-06bc-43fb-a166-e5d918512d85 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:11.366694 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:11.367143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 60/118] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/role_assignments?user.id=f9cc542d589041849760cb3f5ac2c17c&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=cfb149781a404c6892fa0ff5b015482d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:11.368188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7423f6b-06bc-43fb-a166-e5d918512d85 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:11.392625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c10b3-1397-4919-b8d3-85159323fb8c None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:11.436708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ba905-4a62-4efc-a3da-70a07544347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:11.437754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ba905-4a62-4efc-a3da-70a07544347e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.438187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ba905-4a62-4efc-a3da-70a07544347e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.438575 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ba905-4a62-4efc-a3da-70a07544347e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.451090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ba905-4a62-4efc-a3da-70a07544347e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-161ba905-4a62-4efc-a3da-70a07544347e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:11.463446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:11.464768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:11.465823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:11.472130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 59/119] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:11.472130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8b1ad-659a-4f0c-917a-ffd0a6182905 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.472130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8b1ad-659a-4f0c-917a-ffd0a6182905 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.472130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8b1ad-659a-4f0c-917a-ffd0a6182905 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.476083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 60/120] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:11.476750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8b1ad-659a-4f0c-917a-ffd0a6182905 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:11.516417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7423f6b-06bc-43fb-a166-e5d918512d85 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:11.525354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:11.564917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552effaa-2c9c-4f7a-b52d-70ca90280121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:11.566216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552effaa-2c9c-4f7a-b52d-70ca90280121 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.566633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552effaa-2c9c-4f7a-b52d-70ca90280121 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.566978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552effaa-2c9c-4f7a-b52d-70ca90280121 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.567793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552effaa-2c9c-4f7a-b52d-70ca90280121 None admin] RBAC: Adding query filter params (name=member) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:11.568386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552effaa-2c9c-4f7a-b52d-70ca90280121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:11.570555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552effaa-2c9c-4f7a-b52d-70ca90280121 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:11.583203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 61/121] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:11.585184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841efc3-e629-402e-b05b-6951234be0a4 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.585486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841efc3-e629-402e-b05b-6951234be0a4 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.586239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841efc3-e629-402e-b05b-6951234be0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.590189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8b1ad-659a-4f0c-917a-ffd0a6182905 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:11.607580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-9841efc3-e629-402e-b05b-6951234be0a4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:11.609609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9841efc3-e629-402e-b05b-6951234be0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:11.627971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd33ab-3d19-40c5-9428-8ab496f387bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:11.629125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd33ab-3d19-40c5-9428-8ab496f387bc None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.636058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd33ab-3d19-40c5-9428-8ab496f387bc None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.636058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd33ab-3d19-40c5-9428-8ab496f387bc None admin] PATH_INFO: `/v3/users/2c6c1fd699164758801d4c68c84f57b9` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.636058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd33ab-3d19-40c5-9428-8ab496f387bc None admin] RBAC: Authorizing `identity:get_user(user_id=2c6c1fd699164758801d4c68c84f57b9)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:11.636058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd33ab-3d19-40c5-9428-8ab496f387bc None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:11.636058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 61/122] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/users/2c6c1fd699164758801d4c68c84f57b9 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:11.636058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd33ab-3d19-40c5-9428-8ab496f387bc None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:11.658120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:11.709556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 62/123] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:11.711301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841efc3-e629-402e-b05b-6951234be0a4 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:11.754849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd33ab-3d19-40c5-9428-8ab496f387bc None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:11.797996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36f8d-15de-4e7f-b017-4bffbd68750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:11.798798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36f8d-15de-4e7f-b017-4bffbd68750d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.799158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36f8d-15de-4e7f-b017-4bffbd68750d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.799467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36f8d-15de-4e7f-b017-4bffbd68750d None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.800306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36f8d-15de-4e7f-b017-4bffbd68750d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:11.800764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36f8d-15de-4e7f-b017-4bffbd68750d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:11.802237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36f8d-15de-4e7f-b017-4bffbd68750d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:11.813975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 62/124] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:11.814840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36f8d-15de-4e7f-b017-4bffbd68750d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:11.849669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:11.857169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841efc3-e629-402e-b05b-6951234be0a4 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:11.903130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808247e-e530-4550-bad1-e8b6f1984fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:11.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:11.904736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808247e-e530-4550-bad1-e8b6f1984fed None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.906445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808247e-e530-4550-bad1-e8b6f1984fed None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.906888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808247e-e530-4550-bad1-e8b6f1984fed None admin] PATH_INFO: `/v3/users/5b58537fcdd84c4caaed986521aae14c` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.908904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808247e-e530-4550-bad1-e8b6f1984fed None admin] RBAC: Authorizing `identity:get_user(user_id=5b58537fcdd84c4caaed986521aae14c)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:11.910943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808247e-e530-4550-bad1-e8b6f1984fed None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:11.913825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 63/125] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/users/5b58537fcdd84c4caaed986521aae14c => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:11.914804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808247e-e530-4550-bad1-e8b6f1984fed None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:11.932673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36f8d-15de-4e7f-b017-4bffbd68750d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:11.969233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847f1a-7d8b-4666-a79e-c01e702981c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:11.970461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847f1a-7d8b-4666-a79e-c01e702981c7 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.970760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847f1a-7d8b-4666-a79e-c01e702981c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.971043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847f1a-7d8b-4666-a79e-c01e702981c7 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.972617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef847f1a-7d8b-4666-a79e-c01e702981c7 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:11.974730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef847f1a-7d8b-4666-a79e-c01e702981c7 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:11.981778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 63/126] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:11.981778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847f1a-7d8b-4666-a79e-c01e702981c7 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.050937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808247e-e530-4550-bad1-e8b6f1984fed None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.090984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847f1a-7d8b-4666-a79e-c01e702981c7 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.097010 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11abee-f70f-46ac-bf61-202ab7aecc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:12.098014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11abee-f70f-46ac-bf61-202ab7aecc21 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.098443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11abee-f70f-46ac-bf61-202ab7aecc21 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.099374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11abee-f70f-46ac-bf61-202ab7aecc21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.114959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11abee-f70f-46ac-bf61-202ab7aecc21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1e11abee-f70f-46ac-bf61-202ab7aecc21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:12.126363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:12.127382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:12.128311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:12.130654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 64/127] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:12.130921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b26bdf-f9be-4421-8628-ea63718669c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:12.131846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11abee-f70f-46ac-bf61-202ab7aecc21 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.132031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b26bdf-f9be-4421-8628-ea63718669c1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.132414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b26bdf-f9be-4421-8628-ea63718669c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.132800 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b26bdf-f9be-4421-8628-ea63718669c1 None admin] PATH_INFO: `/v3/users/5b58537fcdd84c4caaed986521aae14c` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.134207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b26bdf-f9be-4421-8628-ea63718669c1 None admin] RBAC: Authorizing `identity:get_user(user_id=5b58537fcdd84c4caaed986521aae14c)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:12.135812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b26bdf-f9be-4421-8628-ea63718669c1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:12.137678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 64/128] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:11 2022] GET /identity/v3/users/5b58537fcdd84c4caaed986521aae14c => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:12.143129 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b26bdf-f9be-4421-8628-ea63718669c1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.160693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:12.168327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:12.262584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b26bdf-f9be-4421-8628-ea63718669c1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.265156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11abee-f70f-46ac-bf61-202ab7aecc21 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.302545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a5427-9671-4bd9-b556-e12f5ec8cc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:12.303682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a5427-9671-4bd9-b556-e12f5ec8cc60 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.304072 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a5427-9671-4bd9-b556-e12f5ec8cc60 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.304492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a5427-9671-4bd9-b556-e12f5ec8cc60 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.305753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a5427-9671-4bd9-b556-e12f5ec8cc60 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:12.307367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a5427-9671-4bd9-b556-e12f5ec8cc60 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:12.309164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c675ae0-21b9-498b-b5e2-2f655d914ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:12.310296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c675ae0-21b9-498b-b5e2-2f655d914ebe None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.310710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c675ae0-21b9-498b-b5e2-2f655d914ebe None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.311144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c675ae0-21b9-498b-b5e2-2f655d914ebe None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/users/2c6c1fd699164758801d4c68c84f57b9/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.313514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c675ae0-21b9-498b-b5e2-2f655d914ebe None admin] RBAC: Authorizing `identity:create_grant(project_id=d0cdf4f8802048e4b1ba79f9cae3e998, user_id=2c6c1fd699164758801d4c68c84f57b9, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:12.314083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 65/129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:12 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:12.315001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a5427-9671-4bd9-b556-e12f5ec8cc60 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.315634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c675ae0-21b9-498b-b5e2-2f655d914ebe None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:12.388422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 65/130] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:32:12 2022] PUT /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/users/2c6c1fd699164758801d4c68c84f57b9/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:12.396271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c675ae0-21b9-498b-b5e2-2f655d914ebe None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.443134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:12.455190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a5427-9671-4bd9-b556-e12f5ec8cc60 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.535078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ec489-1917-4715-9d89-63e8230f2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:12.535786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ec489-1917-4715-9d89-63e8230f2d73 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.536079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ec489-1917-4715-9d89-63e8230f2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.536363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ec489-1917-4715-9d89-63e8230f2d73 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.537165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ec489-1917-4715-9d89-63e8230f2d73 None admin] RBAC: Adding query filter params (name=member) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:12.537479 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ec489-1917-4715-9d89-63e8230f2d73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:12.544803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ec489-1917-4715-9d89-63e8230f2d73 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:12.564335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 66/131] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:12.570011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ec489-1917-4715-9d89-63e8230f2d73 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.573213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:12.612713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c675ae0-21b9-498b-b5e2-2f655d914ebe None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.650350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303ea67-7fa5-4d56-8c2a-e1c8f6bac052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:12.651814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303ea67-7fa5-4d56-8c2a-e1c8f6bac052 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.652108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303ea67-7fa5-4d56-8c2a-e1c8f6bac052 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.652394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303ea67-7fa5-4d56-8c2a-e1c8f6bac052 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.653884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303ea67-7fa5-4d56-8c2a-e1c8f6bac052 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:12.656239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303ea67-7fa5-4d56-8c2a-e1c8f6bac052 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:12.659138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 66/132] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:12 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:12.659922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303ea67-7fa5-4d56-8c2a-e1c8f6bac052 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.692135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ec489-1917-4715-9d89-63e8230f2d73 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.734058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd0a12-35b3-4fcf-a170-83617a54c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:12.735268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0a12-35b3-4fcf-a170-83617a54c01a None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.735762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0a12-35b3-4fcf-a170-83617a54c01a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.736418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0a12-35b3-4fcf-a170-83617a54c01a None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/users/5b58537fcdd84c4caaed986521aae14c/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.738810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd0a12-35b3-4fcf-a170-83617a54c01a None admin] RBAC: Authorizing `identity:create_grant(project_id=d0cdf4f8802048e4b1ba79f9cae3e998, user_id=5b58537fcdd84c4caaed986521aae14c, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:12.740752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd0a12-35b3-4fcf-a170-83617a54c01a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:12.787642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303ea67-7fa5-4d56-8c2a-e1c8f6bac052 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.822282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c58e6-df98-48c1-85e2-1bcb3a1ba809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:12.823163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c58e6-df98-48c1-85e2-1bcb3a1ba809 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.823449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c58e6-df98-48c1-85e2-1bcb3a1ba809 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.823726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c58e6-df98-48c1-85e2-1bcb3a1ba809 None admin] PATH_INFO: `/v3/users/5b58537fcdd84c4caaed986521aae14c` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.824913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c58e6-df98-48c1-85e2-1bcb3a1ba809 None admin] RBAC: Authorizing `identity:get_user(user_id=5b58537fcdd84c4caaed986521aae14c)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:12.826405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c58e6-df98-48c1-85e2-1bcb3a1ba809 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:12.828559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 67/133] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:12 2022] GET /identity/v3/users/5b58537fcdd84c4caaed986521aae14c => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:12.829282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c58e6-df98-48c1-85e2-1bcb3a1ba809 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.843575 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:12.849472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 67/134] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:32:12 2022] PUT /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/users/5b58537fcdd84c4caaed986521aae14c/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:12.851978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaceaa8f-e424-4f3f-8a1c-9949e05d72e5 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.852555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaceaa8f-e424-4f3f-8a1c-9949e05d72e5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.853044 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaceaa8f-e424-4f3f-8a1c-9949e05d72e5 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.855392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 68/135] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:12.859603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaceaa8f-e424-4f3f-8a1c-9949e05d72e5 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.883417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:12.984917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c58e6-df98-48c1-85e2-1bcb3a1ba809 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.992032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaceaa8f-e424-4f3f-8a1c-9949e05d72e5 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:13.024609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152a08-6d5f-4925-bc33-6fdc800079bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:13.025531 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152a08-6d5f-4925-bc33-6fdc800079bf None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:13.025875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152a08-6d5f-4925-bc33-6fdc800079bf None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:13.026186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152a08-6d5f-4925-bc33-6fdc800079bf None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/users/5b58537fcdd84c4caaed986521aae14c/roles/a49601657f8b4e909b0a9b2adb444573` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:13.028810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3152a08-6d5f-4925-bc33-6fdc800079bf None admin] RBAC: Authorizing `identity:create_grant(project_id=d0cdf4f8802048e4b1ba79f9cae3e998, user_id=5b58537fcdd84c4caaed986521aae14c, role_id=a49601657f8b4e909b0a9b2adb444573)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:13.030327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3152a08-6d5f-4925-bc33-6fdc800079bf None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:13.045491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dcab8-2c84-4711-882e-3045a133da9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:13.046837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcab8-2c84-4711-882e-3045a133da9c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:13.047332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcab8-2c84-4711-882e-3045a133da9c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:13.047810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcab8-2c84-4711-882e-3045a133da9c None admin] PATH_INFO: `/v3/projects/ea13c41bf1f7482489dc5306b616557f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:13.049559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dcab8-2c84-4711-882e-3045a133da9c None admin] RBAC: Authorizing `identity:get_project(project_id=ea13c41bf1f7482489dc5306b616557f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:13.051366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dcab8-2c84-4711-882e-3045a133da9c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:13.062149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 69/136] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:12 2022] GET /identity/v3/projects/ea13c41bf1f7482489dc5306b616557f => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:13.062149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ddab8-d7de-4931-b97a-74cea4a9875d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:13.062149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ddab8-d7de-4931-b97a-74cea4a9875d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:13.062149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ddab8-d7de-4931-b97a-74cea4a9875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:13.081190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-983ddab8-d7de-4931-b97a-74cea4a9875d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:13.083103 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-983ddab8-d7de-4931-b97a-74cea4a9875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:13.118914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 68/137] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:32:12 2022] PUT /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/users/5b58537fcdd84c4caaed986521aae14c/roles/a49601657f8b4e909b0a9b2adb444573 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:13.120358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152a08-6d5f-4925-bc33-6fdc800079bf None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:13.175180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 70/138] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:13.202746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ddab8-d7de-4931-b97a-74cea4a9875d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:13.235365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:13.317586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ddab8-d7de-4931-b97a-74cea4a9875d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:13.342347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:13.356984 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbf07d-1b42-4249-ab9b-ade8fdedb43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:13.357806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbf07d-1b42-4249-ab9b-ade8fdedb43c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:13.358838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbf07d-1b42-4249-ab9b-ade8fdedb43c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:13.359138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbf07d-1b42-4249-ab9b-ade8fdedb43c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:13.360394 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbf07d-1b42-4249-ab9b-ade8fdedb43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:13.362942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbf07d-1b42-4249-ab9b-ade8fdedb43c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:13.364899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 71/139] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:13.370503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbf07d-1b42-4249-ab9b-ade8fdedb43c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:13.421476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152a08-6d5f-4925-bc33-6fdc800079bf None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:13.480077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55f6ab-3c12-43a8-9c23-f51f96ef996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:13.480994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f6ab-3c12-43a8-9c23-f51f96ef996d None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:13.481287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f6ab-3c12-43a8-9c23-f51f96ef996d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:13.481572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f6ab-3c12-43a8-9c23-f51f96ef996d None admin] PATH_INFO: `/v3/projects/ea13c41bf1f7482489dc5306b616557f/users/5b58537fcdd84c4caaed986521aae14c/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:13.487341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55f6ab-3c12-43a8-9c23-f51f96ef996d None admin] RBAC: Authorizing `identity:create_grant(project_id=ea13c41bf1f7482489dc5306b616557f, user_id=5b58537fcdd84c4caaed986521aae14c, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:13.488776 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55f6ab-3c12-43a8-9c23-f51f96ef996d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:13.493180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:13.510136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbf07d-1b42-4249-ab9b-ade8fdedb43c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:13.558425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 69/140] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:32:13 2022] PUT /identity/v3/projects/ea13c41bf1f7482489dc5306b616557f/users/5b58537fcdd84c4caaed986521aae14c/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:13.559674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83b51-082b-4bcb-83ca-0e1141145bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:13.560421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83b51-082b-4bcb-83ca-0e1141145bed None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:13.560832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83b51-082b-4bcb-83ca-0e1141145bed None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:13.561736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83b51-082b-4bcb-83ca-0e1141145bed None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:13.562661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83b51-082b-4bcb-83ca-0e1141145bed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:13.578365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83b51-082b-4bcb-83ca-0e1141145bed None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:13.578508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41e0c-da19-459b-89b0-c145b74d441a None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:13.578508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41e0c-da19-459b-89b0-c145b74d441a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:13.578508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41e0c-da19-459b-89b0-c145b74d441a None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:13.578508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 70/141] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:13.579921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8071b-22ae-4968-ba43-094ca246fc85 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:13.580229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8071b-22ae-4968-ba43-094ca246fc85 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:13.580525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8071b-22ae-4968-ba43-094ca246fc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:13.602482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-54d8071b-22ae-4968-ba43-094ca246fc85 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:13.603770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-54d8071b-22ae-4968-ba43-094ca246fc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:13.706004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 72/142] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:13 2022] POST /identity/v3/users => generated 283 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:13.728889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 71/143] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:13.765136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83b51-082b-4bcb-83ca-0e1141145bed None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:13.906193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83b51-082b-4bcb-83ca-0e1141145bed None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:13.952314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ab067-39ac-4d57-9a09-93e9b7ba863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:13.953128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ab067-39ac-4d57-9a09-93e9b7ba863f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:13.953417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ab067-39ac-4d57-9a09-93e9b7ba863f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:13.953702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ab067-39ac-4d57-9a09-93e9b7ba863f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:13.964128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:13.974599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ab067-39ac-4d57-9a09-93e9b7ba863f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-ac0ab067-39ac-4d57-9a09-93e9b7ba863f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:13.982839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:13.984223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:13.984988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 73/144] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:13.995086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8071b-22ae-4968-ba43-094ca246fc85 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:14.095064 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:14.142311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8071b-22ae-4968-ba43-094ca246fc85 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:14.191433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a80d3-04b6-4d06-b023-ce89389028c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:14.192536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a80d3-04b6-4d06-b023-ce89389028c4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:14.193040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a80d3-04b6-4d06-b023-ce89389028c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:14.193529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a80d3-04b6-4d06-b023-ce89389028c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:14.194611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a80d3-04b6-4d06-b023-ce89389028c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:14.195159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a80d3-04b6-4d06-b023-ce89389028c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:14.196785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a80d3-04b6-4d06-b023-ce89389028c4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:14.209666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 72/145] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:14.215448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ab067-39ac-4d57-9a09-93e9b7ba863f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:14.374895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ab067-39ac-4d57-9a09-93e9b7ba863f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:14.421468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1658ed-84c5-48ef-957c-72ed39028ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:14.422748 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1658ed-84c5-48ef-957c-72ed39028ca1 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:14.423254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1658ed-84c5-48ef-957c-72ed39028ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:14.423756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1658ed-84c5-48ef-957c-72ed39028ca1 None admin] PATH_INFO: `/v3/users/f9cc542d589041849760cb3f5ac2c17c` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:14.430678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1658ed-84c5-48ef-957c-72ed39028ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=f9cc542d589041849760cb3f5ac2c17c)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:14.432410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1658ed-84c5-48ef-957c-72ed39028ca1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:14.434628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 74/146] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:14 2022] GET /identity/v3/users/f9cc542d589041849760cb3f5ac2c17c => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:14.440505 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a80d3-04b6-4d06-b023-ce89389028c4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:14.569079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a80d3-04b6-4d06-b023-ce89389028c4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:14.601226 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:14.619282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf1634-54e8-46f8-a41e-a3f4722d0e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:14.620450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1634-54e8-46f8-a41e-a3f4722d0e14 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:14.620926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1634-54e8-46f8-a41e-a3f4722d0e14 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:14.621393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1634-54e8-46f8-a41e-a3f4722d0e14 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:14.622866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf1634-54e8-46f8-a41e-a3f4722d0e14 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:14.625127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf1634-54e8-46f8-a41e-a3f4722d0e14 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:14.627104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 73/147] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:14 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:14.636238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1658ed-84c5-48ef-957c-72ed39028ca1 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:14.735634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:14.781757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1658ed-84c5-48ef-957c-72ed39028ca1 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:14.827804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273b726-78a7-482c-b99b-57e2b670b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:14.828755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273b726-78a7-482c-b99b-57e2b670b6d2 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:14.829044 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273b726-78a7-482c-b99b-57e2b670b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:14.829324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273b726-78a7-482c-b99b-57e2b670b6d2 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/users/f9cc542d589041849760cb3f5ac2c17c/roles/cfb149781a404c6892fa0ff5b015482d` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:14.831308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273b726-78a7-482c-b99b-57e2b670b6d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0cdf4f8802048e4b1ba79f9cae3e998, user_id=f9cc542d589041849760cb3f5ac2c17c, role_id=cfb149781a404c6892fa0ff5b015482d)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:14.832779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273b726-78a7-482c-b99b-57e2b670b6d2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:14.922419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 75/148] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:32:14 2022] PUT /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/users/f9cc542d589041849760cb3f5ac2c17c/roles/cfb149781a404c6892fa0ff5b015482d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:15.063617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a8bc5-7659-4941-8151-e4a71a3d29df None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.063940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a8bc5-7659-4941-8151-e4a71a3d29df None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.064200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a8bc5-7659-4941-8151-e4a71a3d29df None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.065642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 74/149] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:15.071930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b7efd-f7dc-4fda-91cf-6e99b07878e5 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.072228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b7efd-f7dc-4fda-91cf-6e99b07878e5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.072511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b7efd-f7dc-4fda-91cf-6e99b07878e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.102746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-927b7efd-f7dc-4fda-91cf-6e99b07878e5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:15.103969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-927b7efd-f7dc-4fda-91cf-6e99b07878e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:15.200834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 76/150] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:15.237991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a8bc5-7659-4941-8151-e4a71a3d29df None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:15.360241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a8bc5-7659-4941-8151-e4a71a3d29df None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:15.397183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a8d14-2374-4ce5-9123-73680f9cc503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:15.398045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a8d14-2374-4ce5-9123-73680f9cc503 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.398338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a8d14-2374-4ce5-9123-73680f9cc503 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.398619 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a8d14-2374-4ce5-9123-73680f9cc503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.410220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a8d14-2374-4ce5-9123-73680f9cc503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-584a8d14-2374-4ce5-9123-73680f9cc503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:15.418284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:15.419221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:15.420014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 75/151] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:15.426406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b7efd-f7dc-4fda-91cf-6e99b07878e5 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:15.492768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:15.540289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b7efd-f7dc-4fda-91cf-6e99b07878e5 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:15.578569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740d1ea-bd81-4816-952e-0147464c7613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:15.579250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740d1ea-bd81-4816-952e-0147464c7613 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.579539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740d1ea-bd81-4816-952e-0147464c7613 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.579820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740d1ea-bd81-4816-952e-0147464c7613 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.580583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740d1ea-bd81-4816-952e-0147464c7613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:15.580893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740d1ea-bd81-4816-952e-0147464c7613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:15.582325 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740d1ea-bd81-4816-952e-0147464c7613 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:15.594550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 77/152] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:15.599601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a8d14-2374-4ce5-9123-73680f9cc503 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:15.655278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:15.727026 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a8d14-2374-4ce5-9123-73680f9cc503 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:15.750282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dcba9-18b4-49a0-8567-792f4874a63a None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.750755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dcba9-18b4-49a0-8567-792f4874a63a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.750755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dcba9-18b4-49a0-8567-792f4874a63a None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.752265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 78/153] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:15.758223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc040-9390-4023-904c-197486e1e4d1 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.758652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc040-9390-4023-904c-197486e1e4d1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.759068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc040-9390-4023-904c-197486e1e4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.788553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-cfcfc040-9390-4023-904c-197486e1e4d1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:15.789747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cfcfc040-9390-4023-904c-197486e1e4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:15.811458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c22e12-f1c0-4e9f-8652-f24c946755f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:15.812344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c22e12-f1c0-4e9f-8652-f24c946755f8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.812628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c22e12-f1c0-4e9f-8652-f24c946755f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.812906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c22e12-f1c0-4e9f-8652-f24c946755f8 None admin] PATH_INFO: `/v3/users/2c6c1fd699164758801d4c68c84f57b9` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.816006 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c22e12-f1c0-4e9f-8652-f24c946755f8 None admin] RBAC: Authorizing `identity:get_user(user_id=2c6c1fd699164758801d4c68c84f57b9)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:15.817551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c22e12-f1c0-4e9f-8652-f24c946755f8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:15.819443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 76/154] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:15 2022] GET /identity/v3/users/2c6c1fd699164758801d4c68c84f57b9 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:15.827448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c22e12-f1c0-4e9f-8652-f24c946755f8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:15.934609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 79/155] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:15.961913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfc040-9390-4023-904c-197486e1e4d1 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:16.002378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c22e12-f1c0-4e9f-8652-f24c946755f8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:16.016257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:16.035776 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:16.063226 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11eb05-7995-4a8b-a8d1-1484788aecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:16.064359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11eb05-7995-4a8b-a8d1-1484788aecc0 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:16.064846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11eb05-7995-4a8b-a8d1-1484788aecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:16.065315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11eb05-7995-4a8b-a8d1-1484788aecc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:16.084612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfc040-9390-4023-904c-197486e1e4d1 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:16.144009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5308c8b-9f11-4ad8-a29f-0506a151b138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:16.145031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5308c8b-9f11-4ad8-a29f-0506a151b138 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:16.145322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5308c8b-9f11-4ad8-a29f-0506a151b138 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:16.145600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5308c8b-9f11-4ad8-a29f-0506a151b138 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:16.166751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5308c8b-9f11-4ad8-a29f-0506a151b138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-e5308c8b-9f11-4ad8-a29f-0506a151b138 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:16.181508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:16.182466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:16.183305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:16.183898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 80/156] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:16.187431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11eb05-7995-4a8b-a8d1-1484788aecc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:16.189325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11eb05-7995-4a8b-a8d1-1484788aecc0 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:16.192074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5308c8b-9f11-4ad8-a29f-0506a151b138 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:16.348346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5308c8b-9f11-4ad8-a29f-0506a151b138 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:16.363837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 77/157] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:16.364510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:16.369439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11eb05-7995-4a8b-a8d1-1484788aecc0 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:16.391638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387b046-411d-4eda-aa51-33c867ad1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:16.393241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b046-411d-4eda-aa51-33c867ad1d64 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:16.393536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b046-411d-4eda-aa51-33c867ad1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:16.393818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b046-411d-4eda-aa51-33c867ad1d64 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:16.394613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387b046-411d-4eda-aa51-33c867ad1d64 None admin] RBAC: Adding query filter params (name=member) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:16.394926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387b046-411d-4eda-aa51-33c867ad1d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:16.397169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387b046-411d-4eda-aa51-33c867ad1d64 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:16.402166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:16.417451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 81/158] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:16.425228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387b046-411d-4eda-aa51-33c867ad1d64 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:16.506782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11eb05-7995-4a8b-a8d1-1484788aecc0 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:16.552853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387b046-411d-4eda-aa51-33c867ad1d64 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:16.583570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca1339-7e0f-44fc-a8cc-457501581b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:16.584807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca1339-7e0f-44fc-a8cc-457501581b47 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:16.585313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca1339-7e0f-44fc-a8cc-457501581b47 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:16.585797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca1339-7e0f-44fc-a8cc-457501581b47 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:16.587491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca1339-7e0f-44fc-a8cc-457501581b47 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:16.589211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca1339-7e0f-44fc-a8cc-457501581b47 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:16.595773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6dad3-2380-4e0d-8b24-de076843c15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:16.596669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6dad3-2380-4e0d-8b24-de076843c15b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:16.596957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6dad3-2380-4e0d-8b24-de076843c15b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:16.597236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6dad3-2380-4e0d-8b24-de076843c15b None admin] PATH_INFO: `/v3/users/5b58537fcdd84c4caaed986521aae14c` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:16.598595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 78/159] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:16 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:16.599285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6dad3-2380-4e0d-8b24-de076843c15b None admin] RBAC: Authorizing `identity:get_user(user_id=5b58537fcdd84c4caaed986521aae14c)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:16.601105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6dad3-2380-4e0d-8b24-de076843c15b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:16.603764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 82/160] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:16 2022] GET /identity/v3/users/5b58537fcdd84c4caaed986521aae14c => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:16.610235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca1339-7e0f-44fc-a8cc-457501581b47 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:16.610663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6dad3-2380-4e0d-8b24-de076843c15b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:16.666354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:16.770834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6dad3-2380-4e0d-8b24-de076843c15b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:16.786406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:16.812386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca1339-7e0f-44fc-a8cc-457501581b47 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:16.836708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbe3ac-3241-4e7e-a892-01ccffeafe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:16.838334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbe3ac-3241-4e7e-a892-01ccffeafe09 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:16.838839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbe3ac-3241-4e7e-a892-01ccffeafe09 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:16.839317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbe3ac-3241-4e7e-a892-01ccffeafe09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:16.867695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a466e0b-72ef-4ed0-b39f-22cb4e9a24fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:16.868641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a466e0b-72ef-4ed0-b39f-22cb4e9a24fb None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:16.869094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a466e0b-72ef-4ed0-b39f-22cb4e9a24fb None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:16.869533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a466e0b-72ef-4ed0-b39f-22cb4e9a24fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:16.870559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a466e0b-72ef-4ed0-b39f-22cb4e9a24fb None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998, user.id=2c6c1fd699164758801d4c68c84f57b9) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:16.871031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a466e0b-72ef-4ed0-b39f-22cb4e9a24fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:16.872630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a466e0b-72ef-4ed0-b39f-22cb4e9a24fb None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:16.883533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 79/161] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:16 2022] GET /identity/v3/role_assignments?user.id=2c6c1fd699164758801d4c68c84f57b9&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:16.961902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbe3ac-3241-4e7e-a892-01ccffeafe09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:16.963487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbe3ac-3241-4e7e-a892-01ccffeafe09 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:17.010506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:17.086510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 83/162] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:17.093091 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a466e0b-72ef-4ed0-b39f-22cb4e9a24fb None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:17.211332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a466e0b-72ef-4ed0-b39f-22cb4e9a24fb None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:17.218386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36bd3-c287-4650-9c6b-ed3c0baa7986 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:17.218677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36bd3-c287-4650-9c6b-ed3c0baa7986 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:17.218961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36bd3-c287-4650-9c6b-ed3c0baa7986 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:17.220678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 84/163] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:17.228347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2875e-759e-47af-aa48-15cfcb4453ce None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:17.228663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2875e-759e-47af-aa48-15cfcb4453ce None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:17.228922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2875e-759e-47af-aa48-15cfcb4453ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:17.251673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d3a2875e-759e-47af-aa48-15cfcb4453ce None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:17.253162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d3a2875e-759e-47af-aa48-15cfcb4453ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:17.293579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e7bc5-eca8-4b37-9a67-2f343f24f269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:17.297959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e7bc5-eca8-4b37-9a67-2f343f24f269 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:17.297959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e7bc5-eca8-4b37-9a67-2f343f24f269 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:17.297959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e7bc5-eca8-4b37-9a67-2f343f24f269 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:17.297959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e7bc5-eca8-4b37-9a67-2f343f24f269 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:17.298683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e7bc5-eca8-4b37-9a67-2f343f24f269 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:17.300594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 80/164] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:17 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:17.306183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e7bc5-eca8-4b37-9a67-2f343f24f269 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:17.341174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:17.402516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 85/165] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:17.403892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9320db-5e0a-4465-aac8-b02842b99eb9 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:17.404185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9320db-5e0a-4465-aac8-b02842b99eb9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:17.404467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9320db-5e0a-4465-aac8-b02842b99eb9 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:17.405792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 86/166] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:17.412550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb7b8-51bc-42b8-b0b0-03338c37495d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:17.412842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb7b8-51bc-42b8-b0b0-03338c37495d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:17.413125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb7b8-51bc-42b8-b0b0-03338c37495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:17.441845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-953fb7b8-51bc-42b8-b0b0-03338c37495d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:17.443288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-953fb7b8-51bc-42b8-b0b0-03338c37495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:17.544654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 87/167] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:17.545178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:17.550810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fb7b8-51bc-42b8-b0b0-03338c37495d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:17.557713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e7bc5-eca8-4b37-9a67-2f343f24f269 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:17.643545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b9d5d-49b6-440b-b404-3d9b1a89e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:17.644270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b9d5d-49b6-440b-b404-3d9b1a89e0aa None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:17.644508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b9d5d-49b6-440b-b404-3d9b1a89e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:17.644784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b9d5d-49b6-440b-b404-3d9b1a89e0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:17.645637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b9d5d-49b6-440b-b404-3d9b1a89e0aa None admin] RBAC: Adding query filter params (role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998, user.id=5b58537fcdd84c4caaed986521aae14c) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:17.645982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b9d5d-49b6-440b-b404-3d9b1a89e0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:17.647442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b9d5d-49b6-440b-b404-3d9b1a89e0aa None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:17.661038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 81/168] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:17 2022] GET /identity/v3/role_assignments?user.id=5b58537fcdd84c4caaed986521aae14c&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:17.664361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b9d5d-49b6-440b-b404-3d9b1a89e0aa None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:17.705139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fb7b8-51bc-42b8-b0b0-03338c37495d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:17.755881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41660003-716b-42b5-bb1b-21753b50c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:17.756715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41660003-716b-42b5-bb1b-21753b50c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:17.757007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41660003-716b-42b5-bb1b-21753b50c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:17.757287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41660003-716b-42b5-bb1b-21753b50c4f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:17.779737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41660003-716b-42b5-bb1b-21753b50c4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-41660003-716b-42b5-bb1b-21753b50c4f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:17.791977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:17.793126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:17.793911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 88/169] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:17.803643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41660003-716b-42b5-bb1b-21753b50c4f0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:17.885922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:17.913123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b9d5d-49b6-440b-b404-3d9b1a89e0aa None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:17.959175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:17.968330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc062908-5002-429b-b731-3a303a59c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:17.973344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062908-5002-429b-b731-3a303a59c808 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:17.973344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062908-5002-429b-b731-3a303a59c808 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:17.973344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062908-5002-429b-b731-3a303a59c808 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.004642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc062908-5002-429b-b731-3a303a59c808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-cc062908-5002-429b-b731-3a303a59c808 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:18.012935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:18.013841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:18.014690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:18.015829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 82/170] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:18.031902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc062908-5002-429b-b731-3a303a59c808 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:18.059135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41660003-716b-42b5-bb1b-21753b50c4f0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:18.125904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f4b6b-3184-43bc-ae63-427589831781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:18.126608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f4b6b-3184-43bc-ae63-427589831781 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.126898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f4b6b-3184-43bc-ae63-427589831781 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.127176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f4b6b-3184-43bc-ae63-427589831781 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.127940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f4b6b-3184-43bc-ae63-427589831781 None admin] RBAC: Adding query filter params (name=member) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:18.128253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f4b6b-3184-43bc-ae63-427589831781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:18.129668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f4b6b-3184-43bc-ae63-427589831781 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:18.140627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 89/171] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:18.145973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f4b6b-3184-43bc-ae63-427589831781 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:18.259416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc062908-5002-429b-b731-3a303a59c808 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:18.332590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f4b6b-3184-43bc-ae63-427589831781 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:18.355965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8d99-7aac-46fd-8a6d-d423be641ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:18.356649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8d99-7aac-46fd-8a6d-d423be641ec0 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.356936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8d99-7aac-46fd-8a6d-d423be641ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.357216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8d99-7aac-46fd-8a6d-d423be641ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.358672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8d99-7aac-46fd-8a6d-d423be641ec0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:18.358982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8d99-7aac-46fd-8a6d-d423be641ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:18.360375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8d99-7aac-46fd-8a6d-d423be641ec0 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:18.370313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:18.381078 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 83/172] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:18.389245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8d99-7aac-46fd-8a6d-d423be641ec0 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:18.399948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:18.410887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f89a88-083f-421d-8cae-e3175f03551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:18.411694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f89a88-083f-421d-8cae-e3175f03551e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.412397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f89a88-083f-421d-8cae-e3175f03551e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.412687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f89a88-083f-421d-8cae-e3175f03551e None admin] PATH_INFO: `/v3/users/5b58537fcdd84c4caaed986521aae14c` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.418446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f89a88-083f-421d-8cae-e3175f03551e None admin] RBAC: Authorizing `identity:get_user(user_id=5b58537fcdd84c4caaed986521aae14c)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:18.420704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f89a88-083f-421d-8cae-e3175f03551e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:18.422636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 90/173] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:18 2022] GET /identity/v3/users/5b58537fcdd84c4caaed986521aae14c => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:18.428461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f89a88-083f-421d-8cae-e3175f03551e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:18.620367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f89a88-083f-421d-8cae-e3175f03551e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:18.672716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8d99-7aac-46fd-8a6d-d423be641ec0 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:18.679693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104d4d0-d4d5-4b65-b69f-58372a69021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:18.680606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d4d0-d4d5-4b65-b69f-58372a69021a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.681125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d4d0-d4d5-4b65-b69f-58372a69021a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.681602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d4d0-d4d5-4b65-b69f-58372a69021a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.754312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:18.758587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d4d0-d4d5-4b65-b69f-58372a69021a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:18.760411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d4d0-d4d5-4b65-b69f-58372a69021a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:18.766652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333b6c6-4463-4043-b6a7-4e6330d26238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:18.767548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333b6c6-4463-4043-b6a7-4e6330d26238 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.767833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333b6c6-4463-4043-b6a7-4e6330d26238 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.768114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333b6c6-4463-4043-b6a7-4e6330d26238 None admin] PATH_INFO: `/v3/users/5b58537fcdd84c4caaed986521aae14c` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.774762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333b6c6-4463-4043-b6a7-4e6330d26238 None admin] RBAC: Authorizing `identity:get_user(user_id=5b58537fcdd84c4caaed986521aae14c)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:18.777766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333b6c6-4463-4043-b6a7-4e6330d26238 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:18.778183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 84/174] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:18 2022] GET /identity/v3/users/5b58537fcdd84c4caaed986521aae14c => generated 275 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:18.779509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fce77-0c4b-45e5-b065-efd9a8dfcf94 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.779799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fce77-0c4b-45e5-b065-efd9a8dfcf94 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.780084 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fce77-0c4b-45e5-b065-efd9a8dfcf94 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.781325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 85/175] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:18.783382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fce77-0c4b-45e5-b065-efd9a8dfcf94 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:18.887477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:18.889268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 91/176] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:32:18.895624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed2202-b6a4-49f7-8f4c-30579a414ff0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.895922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed2202-b6a4-49f7-8f4c-30579a414ff0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.896208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed2202-b6a4-49f7-8f4c-30579a414ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.918855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-92ed2202-b6a4-49f7-8f4c-30579a414ff0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:18.921331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-92ed2202-b6a4-49f7-8f4c-30579a414ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:18.924202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fce77-0c4b-45e5-b065-efd9a8dfcf94 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:18.974648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04c5a9-073a-4049-af96-6c95cd354fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:18.976125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04c5a9-073a-4049-af96-6c95cd354fcc None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.976574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04c5a9-073a-4049-af96-6c95cd354fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.977006 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04c5a9-073a-4049-af96-6c95cd354fcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.996259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 92/177] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:18.997812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825a3ed-da60-43f6-bfea-bafb7e18cc57 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.998258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825a3ed-da60-43f6-bfea-bafb7e18cc57 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.998640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825a3ed-da60-43f6-bfea-bafb7e18cc57 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.000319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 93/178] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:19.001154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825a3ed-da60-43f6-bfea-bafb7e18cc57 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:19.029139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.068120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04c5a9-073a-4049-af96-6c95cd354fcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:19.070186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04c5a9-073a-4049-af96-6c95cd354fcc None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:19.125028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825a3ed-da60-43f6-bfea-bafb7e18cc57 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:19.164850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.168458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402de19-33dc-4828-b473-35fc39269d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:19.169469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402de19-33dc-4828-b473-35fc39269d8e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.169857 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402de19-33dc-4828-b473-35fc39269d8e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.170826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402de19-33dc-4828-b473-35fc39269d8e None admin] PATH_INFO: `/v3/projects/ea13c41bf1f7482489dc5306b616557f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.172384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402de19-33dc-4828-b473-35fc39269d8e None admin] RBAC: Authorizing `identity:get_project(project_id=ea13c41bf1f7482489dc5306b616557f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:19.173911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402de19-33dc-4828-b473-35fc39269d8e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:19.183921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 94/179] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/projects/ea13c41bf1f7482489dc5306b616557f => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:19.183921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174e5b4-de77-4a73-a08d-8bbcf467e36d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.183921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174e5b4-de77-4a73-a08d-8bbcf467e36d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.183921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174e5b4-de77-4a73-a08d-8bbcf467e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.195589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b174e5b4-de77-4a73-a08d-8bbcf467e36d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:19.196921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b174e5b4-de77-4a73-a08d-8bbcf467e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:19.209562 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 86/180] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:19.214758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04c5a9-073a-4049-af96-6c95cd354fcc None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:19.267580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 95/181] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:19.268772 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174e5b4-de77-4a73-a08d-8bbcf467e36d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:19.292439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.330247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04c5a9-073a-4049-af96-6c95cd354fcc None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:19.368785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aaddf-d938-4647-9da5-fe037825f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:19.369587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aaddf-d938-4647-9da5-fe037825f7ff None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.369870 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aaddf-d938-4647-9da5-fe037825f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.370174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aaddf-d938-4647-9da5-fe037825f7ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.380237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62aaddf-d938-4647-9da5-fe037825f7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:19.384299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174e5b4-de77-4a73-a08d-8bbcf467e36d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-d62aaddf-d938-4647-9da5-fe037825f7ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:19.387866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:19.388725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:19.390218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 87/182] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:19.390893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd275fbe-929c-45f1-8af6-1e414de1990b None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.397216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd275fbe-929c-45f1-8af6-1e414de1990b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.397216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd275fbe-929c-45f1-8af6-1e414de1990b None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.397216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 88/183] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:19.397216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd275fbe-929c-45f1-8af6-1e414de1990b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:19.428162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.431027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b3849-b4aa-466d-ab6d-0ec2b99f1ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:19.431700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b3849-b4aa-466d-ab6d-0ec2b99f1ab1 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.431990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b3849-b4aa-466d-ab6d-0ec2b99f1ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.432272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b3849-b4aa-466d-ab6d-0ec2b99f1ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.433125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b3849-b4aa-466d-ab6d-0ec2b99f1ab1 None admin] RBAC: Adding query filter params (role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=ea13c41bf1f7482489dc5306b616557f, user.id=5b58537fcdd84c4caaed986521aae14c) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:19.433437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b3849-b4aa-466d-ab6d-0ec2b99f1ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:19.435018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b3849-b4aa-466d-ab6d-0ec2b99f1ab1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:19.442815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 96/184] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/role_assignments?user.id=5b58537fcdd84c4caaed986521aae14c&scope.project.id=ea13c41bf1f7482489dc5306b616557f&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:19.443644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b3849-b4aa-466d-ab6d-0ec2b99f1ab1 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:19.508622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd275fbe-929c-45f1-8af6-1e414de1990b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:19.539986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.547672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf355c5-556f-4967-89a8-7a53291c395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:19.548561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf355c5-556f-4967-89a8-7a53291c395b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.548942 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf355c5-556f-4967-89a8-7a53291c395b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.549312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf355c5-556f-4967-89a8-7a53291c395b None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.550595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf355c5-556f-4967-89a8-7a53291c395b None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:19.552567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf355c5-556f-4967-89a8-7a53291c395b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:19.553985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 89/185] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:19.553985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98a6bc-d982-4f6b-b0ae-62a5a1b3e130 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.553985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98a6bc-d982-4f6b-b0ae-62a5a1b3e130 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.553985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98a6bc-d982-4f6b-b0ae-62a5a1b3e130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.566418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b3849-b4aa-466d-ab6d-0ec2b99f1ab1 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:19.573554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-bf98a6bc-d982-4f6b-b0ae-62a5a1b3e130 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:19.574808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bf98a6bc-d982-4f6b-b0ae-62a5a1b3e130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:19.609903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f216a7-aa74-4b68-88b1-e11706ab6524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:19.610733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f216a7-aa74-4b68-88b1-e11706ab6524 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.611024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f216a7-aa74-4b68-88b1-e11706ab6524 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.611317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f216a7-aa74-4b68-88b1-e11706ab6524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.623894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f216a7-aa74-4b68-88b1-e11706ab6524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-38f216a7-aa74-4b68-88b1-e11706ab6524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:19.631776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:19.632638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:19.633416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 97/186] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:19.634625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f216a7-aa74-4b68-88b1-e11706ab6524 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:19.658208 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 90/187] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:19.659396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48494cce-6b3a-4bbd-ad75-800c385ce103 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.659693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48494cce-6b3a-4bbd-ad75-800c385ce103 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.660034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48494cce-6b3a-4bbd-ad75-800c385ce103 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.661318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 91/188] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:19.665912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48494cce-6b3a-4bbd-ad75-800c385ce103 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:19.701321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.745789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f216a7-aa74-4b68-88b1-e11706ab6524 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:19.774531 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48494cce-6b3a-4bbd-ad75-800c385ce103 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:19.780027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d853d-7547-4d9f-97ec-f7bdeb9d33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:19.780701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d853d-7547-4d9f-97ec-f7bdeb9d33cb None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.780986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d853d-7547-4d9f-97ec-f7bdeb9d33cb None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.781263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d853d-7547-4d9f-97ec-f7bdeb9d33cb None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.782041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d853d-7547-4d9f-97ec-f7bdeb9d33cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:19.782360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d853d-7547-4d9f-97ec-f7bdeb9d33cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:19.783789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d853d-7547-4d9f-97ec-f7bdeb9d33cb None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:19.791997 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 98/189] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:19.792779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d853d-7547-4d9f-97ec-f7bdeb9d33cb None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:19.795962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.809431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce361-1ccb-438d-8003-f9e500753d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:19.810121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce361-1ccb-438d-8003-f9e500753d9d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.810409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce361-1ccb-438d-8003-f9e500753d9d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.810712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce361-1ccb-438d-8003-f9e500753d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.811557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce361-1ccb-438d-8003-f9e500753d9d None admin] RBAC: Adding query filter params (role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998, user.id=5b58537fcdd84c4caaed986521aae14c) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:19.811866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce361-1ccb-438d-8003-f9e500753d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:19.813306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce361-1ccb-438d-8003-f9e500753d9d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:19.819058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 92/190] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/role_assignments?user.id=5b58537fcdd84c4caaed986521aae14c&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:19.820207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d681f2-379d-41a1-ab86-bde8bc381f99 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.820497 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d681f2-379d-41a1-ab86-bde8bc381f99 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.820794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d681f2-379d-41a1-ab86-bde8bc381f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.849572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-42d681f2-379d-41a1-ab86-bde8bc381f99 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:19.851071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-42d681f2-379d-41a1-ab86-bde8bc381f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:19.911688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d853d-7547-4d9f-97ec-f7bdeb9d33cb None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:19.932483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 93/191] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:19.933483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d681f2-379d-41a1-ab86-bde8bc381f99 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:19.958858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea997da9-99c3-4361-8ba7-ea63241ac0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:19.959965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea997da9-99c3-4361-8ba7-ea63241ac0c3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.960471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea997da9-99c3-4361-8ba7-ea63241ac0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.960921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea997da9-99c3-4361-8ba7-ea63241ac0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.961856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea997da9-99c3-4361-8ba7-ea63241ac0c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:19.962550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea997da9-99c3-4361-8ba7-ea63241ac0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:19.964274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea997da9-99c3-4361-8ba7-ea63241ac0c3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:19.969235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.974354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 99/192] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:19.975552 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea997da9-99c3-4361-8ba7-ea63241ac0c3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:20.050056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:20.052656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d681f2-379d-41a1-ab86-bde8bc381f99 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.087176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbc14e-76e3-4f5c-90df-603df4310b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:20.087973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbc14e-76e3-4f5c-90df-603df4310b51 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:20.088265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbc14e-76e3-4f5c-90df-603df4310b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:20.088449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea997da9-99c3-4361-8ba7-ea63241ac0c3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.088553 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbc14e-76e3-4f5c-90df-603df4310b51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:20.089716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbc14e-76e3-4f5c-90df-603df4310b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:20.091209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbc14e-76e3-4f5c-90df-603df4310b51 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:20.093438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 94/193] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:20.094311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbc14e-76e3-4f5c-90df-603df4310b51 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:20.124421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264397-f2f3-4bcf-a635-33efd3ca61ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:20.125298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264397-f2f3-4bcf-a635-33efd3ca61ba None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:20.125586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264397-f2f3-4bcf-a635-33efd3ca61ba None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:20.125868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264397-f2f3-4bcf-a635-33efd3ca61ba None admin] PATH_INFO: `/v3/users/f9cc542d589041849760cb3f5ac2c17c` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:20.127097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7264397-f2f3-4bcf-a635-33efd3ca61ba None admin] RBAC: Authorizing `identity:get_user(user_id=f9cc542d589041849760cb3f5ac2c17c)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:20.128555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7264397-f2f3-4bcf-a635-33efd3ca61ba None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:20.130379 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 100/194] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:19 2022] GET /identity/v3/users/f9cc542d589041849760cb3f5ac2c17c => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:20.131046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264397-f2f3-4bcf-a635-33efd3ca61ba None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:20.183891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:20.192384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbc14e-76e3-4f5c-90df-603df4310b51 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.228208 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54d781-db2f-489b-b4d9-45c69020f591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:20.228936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54d781-db2f-489b-b4d9-45c69020f591 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:20.229218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54d781-db2f-489b-b4d9-45c69020f591 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:20.229494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54d781-db2f-489b-b4d9-45c69020f591 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:20.229949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264397-f2f3-4bcf-a635-33efd3ca61ba None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.239465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54d781-db2f-489b-b4d9-45c69020f591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-7b54d781-db2f-489b-b4d9-45c69020f591 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:20.247512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:20.248558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:20.249538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 95/195] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:20.250361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54d781-db2f-489b-b4d9-45c69020f591 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:20.259489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:20.265057 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910740-cbd1-42ff-b2dc-0a8a5975da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:20.266051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910740-cbd1-42ff-b2dc-0a8a5975da8f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:20.270618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910740-cbd1-42ff-b2dc-0a8a5975da8f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:20.270618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910740-cbd1-42ff-b2dc-0a8a5975da8f None admin] PATH_INFO: `/v3/users/ada4fae1332f4f1b98ede70d2e0a899b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:20.280928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b910740-cbd1-42ff-b2dc-0a8a5975da8f None admin] RBAC: Authorizing `identity:get_user(user_id=ada4fae1332f4f1b98ede70d2e0a899b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:20.282437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b910740-cbd1-42ff-b2dc-0a8a5975da8f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:20.284097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 101/196] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:20 2022] GET /identity/v3/users/ada4fae1332f4f1b98ede70d2e0a899b => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:20.284853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910740-cbd1-42ff-b2dc-0a8a5975da8f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:20.353586 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54d781-db2f-489b-b4d9-45c69020f591 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.383484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910740-cbd1-42ff-b2dc-0a8a5975da8f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.385848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015c22-2fc7-41ab-a785-091515bf1d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:20.386545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015c22-2fc7-41ab-a785-091515bf1d31 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:20.386836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015c22-2fc7-41ab-a785-091515bf1d31 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:20.387119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015c22-2fc7-41ab-a785-091515bf1d31 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:20.387829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015c22-2fc7-41ab-a785-091515bf1d31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:20.389869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015c22-2fc7-41ab-a785-091515bf1d31 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:20.417078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b760ac-6ad1-4704-9134-609b300d8b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:20.417719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b760ac-6ad1-4704-9134-609b300d8b72 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:20.418037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b760ac-6ad1-4704-9134-609b300d8b72 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:20.418316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b760ac-6ad1-4704-9134-609b300d8b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:20.474868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:20.485959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b760ac-6ad1-4704-9134-609b300d8b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:20.487439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b760ac-6ad1-4704-9134-609b300d8b72 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:20.488791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 96/197] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:20 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:20.489605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015c22-2fc7-41ab-a785-091515bf1d31 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:20.503950 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:20.601358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 102/198] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:20.602647 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b760ac-6ad1-4704-9134-609b300d8b72 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:20.613182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015c22-2fc7-41ab-a785-091515bf1d31 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.655704 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1f726-0935-495d-b4e8-7c4a8ba1f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:20.656392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1f726-0935-495d-b4e8-7c4a8ba1f6cb None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:20.656678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1f726-0935-495d-b4e8-7c4a8ba1f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:20.656952 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1f726-0935-495d-b4e8-7c4a8ba1f6cb None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:20.657713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1f726-0935-495d-b4e8-7c4a8ba1f6cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:20.658044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1f726-0935-495d-b4e8-7c4a8ba1f6cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:20.659439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1f726-0935-495d-b4e8-7c4a8ba1f6cb None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:20.668302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 97/199] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:20.674179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1f726-0935-495d-b4e8-7c4a8ba1f6cb None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:20.711642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:20.725388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b760ac-6ad1-4704-9134-609b300d8b72 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.759259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:20.772841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd938d9-49ac-45cc-a4a2-32a406262bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:20.773511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd938d9-49ac-45cc-a4a2-32a406262bcc None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:20.773802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd938d9-49ac-45cc-a4a2-32a406262bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:20.774182 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd938d9-49ac-45cc-a4a2-32a406262bcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:20.798932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1f726-0935-495d-b4e8-7c4a8ba1f6cb None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.841875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7a1d4-7954-4fb3-9702-496cc394dfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:20.843337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7a1d4-7954-4fb3-9702-496cc394dfc8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:20.843626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7a1d4-7954-4fb3-9702-496cc394dfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:20.843905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7a1d4-7954-4fb3-9702-496cc394dfc8 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:20.845146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7a1d4-7954-4fb3-9702-496cc394dfc8 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:20.846657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7a1d4-7954-4fb3-9702-496cc394dfc8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:20.848607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 98/200] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:20 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:20.849149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7a1d4-7954-4fb3-9702-496cc394dfc8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:20.867698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd938d9-49ac-45cc-a4a2-32a406262bcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:20.869995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd938d9-49ac-45cc-a4a2-32a406262bcc None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:20.976645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7a1d4-7954-4fb3-9702-496cc394dfc8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:20.978293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:20.990139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 103/201] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:20.991267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd938d9-49ac-45cc-a4a2-32a406262bcc None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:21.020765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d800a-83ae-4321-bfe3-6ce87b643b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:21.021564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d800a-83ae-4321-bfe3-6ce87b643b79 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.021854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d800a-83ae-4321-bfe3-6ce87b643b79 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.022193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d800a-83ae-4321-bfe3-6ce87b643b79 None admin] PATH_INFO: `/v3/users/ada4fae1332f4f1b98ede70d2e0a899b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.023390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d800a-83ae-4321-bfe3-6ce87b643b79 None admin] RBAC: Authorizing `identity:get_user(user_id=ada4fae1332f4f1b98ede70d2e0a899b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:21.024850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d800a-83ae-4321-bfe3-6ce87b643b79 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:21.031893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 99/202] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:20 2022] GET /identity/v3/users/ada4fae1332f4f1b98ede70d2e0a899b => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:21.031893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d800a-83ae-4321-bfe3-6ce87b643b79 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:21.039367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:21.127737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd938d9-49ac-45cc-a4a2-32a406262bcc None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:21.137338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d800a-83ae-4321-bfe3-6ce87b643b79 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:21.170617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdb7e8-59c7-4d89-ae65-35b2ccbfec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:21.172056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdb7e8-59c7-4d89-ae65-35b2ccbfec87 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.172750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdb7e8-59c7-4d89-ae65-35b2ccbfec87 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.173440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdb7e8-59c7-4d89-ae65-35b2ccbfec87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.175430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdb7e8-59c7-4d89-ae65-35b2ccbfec87 None admin] RBAC: Adding query filter params (role.id=cfb149781a404c6892fa0ff5b015482d, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998, user.id=f9cc542d589041849760cb3f5ac2c17c) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:21.176210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdb7e8-59c7-4d89-ae65-35b2ccbfec87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:21.177248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1b82b-c3c9-4d7d-aa43-37456146d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:21.178162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1b82b-c3c9-4d7d-aa43-37456146d783 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.178454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1b82b-c3c9-4d7d-aa43-37456146d783 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.178736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1b82b-c3c9-4d7d-aa43-37456146d783 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.179958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1b82b-c3c9-4d7d-aa43-37456146d783 None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:21.180464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdb7e8-59c7-4d89-ae65-35b2ccbfec87 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:21.181408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1b82b-c3c9-4d7d-aa43-37456146d783 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:21.183178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 100/203] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:21 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:21.187185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1b82b-c3c9-4d7d-aa43-37456146d783 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:21.196119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 104/204] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:20 2022] GET /identity/v3/role_assignments?user.id=f9cc542d589041849760cb3f5ac2c17c&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=cfb149781a404c6892fa0ff5b015482d => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:21.197188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdb7e8-59c7-4d89-ae65-35b2ccbfec87 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:21.290699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:21.346754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:21.349464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdb7e8-59c7-4d89-ae65-35b2ccbfec87 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:21.401116 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1b82b-c3c9-4d7d-aa43-37456146d783 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:21.410681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf655b8c-3bad-4ebe-9b8b-a52779e10555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:21.411351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf655b8c-3bad-4ebe-9b8b-a52779e10555 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.411637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf655b8c-3bad-4ebe-9b8b-a52779e10555 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.411923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf655b8c-3bad-4ebe-9b8b-a52779e10555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.413230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf655b8c-3bad-4ebe-9b8b-a52779e10555 None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=d88de896b4844391a04f85a2cc39591b, user.id=ada4fae1332f4f1b98ede70d2e0a899b) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:21.413548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf655b8c-3bad-4ebe-9b8b-a52779e10555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:21.415437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf655b8c-3bad-4ebe-9b8b-a52779e10555 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:21.422665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 105/205] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:21 2022] GET /identity/v3/role_assignments?user.id=ada4fae1332f4f1b98ede70d2e0a899b&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:21.449795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d7db1-e249-4f65-8a1a-3fd05021e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:21.450964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d7db1-e249-4f65-8a1a-3fd05021e9e5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.452211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d7db1-e249-4f65-8a1a-3fd05021e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.452897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d7db1-e249-4f65-8a1a-3fd05021e9e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.539554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d7db1-e249-4f65-8a1a-3fd05021e9e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:21.541471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d7db1-e249-4f65-8a1a-3fd05021e9e5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:21.620379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:21.646565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 101/206] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:21.652161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf655b8c-3bad-4ebe-9b8b-a52779e10555 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:21.768643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf655b8c-3bad-4ebe-9b8b-a52779e10555 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:21.787933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:21.814017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268665a-7912-46ed-8eac-ddbcb13c4bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:21.814017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268665a-7912-46ed-8eac-ddbcb13c4bbd None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.814017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268665a-7912-46ed-8eac-ddbcb13c4bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.814017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268665a-7912-46ed-8eac-ddbcb13c4bbd None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.814390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268665a-7912-46ed-8eac-ddbcb13c4bbd None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:21.814696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268665a-7912-46ed-8eac-ddbcb13c4bbd None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:21.816696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 106/207] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:21 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:21.822569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d7db1-e249-4f65-8a1a-3fd05021e9e5 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:21.943859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d7db1-e249-4f65-8a1a-3fd05021e9e5 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:21.978588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a85bc5-2682-4297-8730-3afbb62e3d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:21.979245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a85bc5-2682-4297-8730-3afbb62e3d08 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.979530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a85bc5-2682-4297-8730-3afbb62e3d08 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.979810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a85bc5-2682-4297-8730-3afbb62e3d08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.980653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a85bc5-2682-4297-8730-3afbb62e3d08 None admin] RBAC: Adding query filter params (role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=d88de896b4844391a04f85a2cc39591b, user.id=ada4fae1332f4f1b98ede70d2e0a899b) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:21.980967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a85bc5-2682-4297-8730-3afbb62e3d08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:21.982980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a85bc5-2682-4297-8730-3afbb62e3d08 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:21.988894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 102/208] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:21 2022] GET /identity/v3/role_assignments?user.id=ada4fae1332f4f1b98ede70d2e0a899b&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:22.710267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb778e-41e2-4706-abef-f43a9ac9514b None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:22.710810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb778e-41e2-4706-abef-f43a9ac9514b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:22.710810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb778e-41e2-4706-abef-f43a9ac9514b None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:22.712428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 107/209] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:22.717552 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436078e6-8259-4219-8cb3-d68fcac29d95 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:22.717847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436078e6-8259-4219-8cb3-d68fcac29d95 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:22.718176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436078e6-8259-4219-8cb3-d68fcac29d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:22.738097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-436078e6-8259-4219-8cb3-d68fcac29d95 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:22.739295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-436078e6-8259-4219-8cb3-d68fcac29d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:22.770277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:22.780561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899e13a-d22f-4b41-a0eb-6f98adc463a9 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:22.781115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899e13a-d22f-4b41-a0eb-6f98adc463a9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:22.781560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899e13a-d22f-4b41-a0eb-6f98adc463a9 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:22.783133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 108/210] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:22.788233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3921e7-9e65-41c3-84de-01eec61a7038 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:22.788758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3921e7-9e65-41c3-84de-01eec61a7038 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:22.789419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3921e7-9e65-41c3-84de-01eec61a7038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:22.809340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-fc3921e7-9e65-41c3-84de-01eec61a7038 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:22.811120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fc3921e7-9e65-41c3-84de-01eec61a7038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:22.812591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 103/211] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:22.835830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436078e6-8259-4219-8cb3-d68fcac29d95 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:22.884788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 109/212] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:22.909645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3921e7-9e65-41c3-84de-01eec61a7038 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:22.956740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436078e6-8259-4219-8cb3-d68fcac29d95 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:22.994639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c8e4-b6a1-44b9-addb-dfa5e7bb1009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:22.995753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c8e4-b6a1-44b9-addb-dfa5e7bb1009 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:22.996336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c8e4-b6a1-44b9-addb-dfa5e7bb1009 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:22.996814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c8e4-b6a1-44b9-addb-dfa5e7bb1009 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.008904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9c8e4-b6a1-44b9-addb-dfa5e7bb1009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:23.016287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3921e7-9e65-41c3-84de-01eec61a7038 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-60d9c8e4-b6a1-44b9-addb-dfa5e7bb1009 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:23.017854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:23.018724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:23.019512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:23.026802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 104/213] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:23.028037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c8e4-b6a1-44b9-addb-dfa5e7bb1009 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:23.034213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:23.053004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b9448-116c-4946-bedd-bf31e44b1298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:23.054169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b9448-116c-4946-bedd-bf31e44b1298 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.054651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b9448-116c-4946-bedd-bf31e44b1298 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.055138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b9448-116c-4946-bedd-bf31e44b1298 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.056907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b9448-116c-4946-bedd-bf31e44b1298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:23.058650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b9448-116c-4946-bedd-bf31e44b1298 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:23.061386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 110/214] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:23.066382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b9448-116c-4946-bedd-bf31e44b1298 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:23.067318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:23.152461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c8e4-b6a1-44b9-addb-dfa5e7bb1009 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:23.193733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79bf12-71c9-4bd0-8a65-a9f99cae3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:23.194807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79bf12-71c9-4bd0-8a65-a9f99cae3c14 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.195465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79bf12-71c9-4bd0-8a65-a9f99cae3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.195990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79bf12-71c9-4bd0-8a65-a9f99cae3c14 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.196924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79bf12-71c9-4bd0-8a65-a9f99cae3c14 None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:23.197443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79bf12-71c9-4bd0-8a65-a9f99cae3c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:23.199033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79bf12-71c9-4bd0-8a65-a9f99cae3c14 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:23.207433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b9448-116c-4946-bedd-bf31e44b1298 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:23.208479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 105/215] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:23.213861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79bf12-71c9-4bd0-8a65-a9f99cae3c14 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:23.250913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbacda3-4175-4dac-9c50-1a50b380885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:23.251815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbacda3-4175-4dac-9c50-1a50b380885e None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.252246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbacda3-4175-4dac-9c50-1a50b380885e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.252669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbacda3-4175-4dac-9c50-1a50b380885e None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.253544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbacda3-4175-4dac-9c50-1a50b380885e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:23.255317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbacda3-4175-4dac-9c50-1a50b380885e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:23.320423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:23.330273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79bf12-71c9-4bd0-8a65-a9f99cae3c14 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:23.362552 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 111/216] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:23 2022] POST /identity/v3/users => generated 297 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:23.369725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068da170-fdb3-4872-8f91-926d32da2606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:23.371342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068da170-fdb3-4872-8f91-926d32da2606 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.371855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068da170-fdb3-4872-8f91-926d32da2606 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.372447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068da170-fdb3-4872-8f91-926d32da2606 None admin] PATH_INFO: `/v3/users/b4f8db193d924987b1bfb460e1091ba2` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.390673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068da170-fdb3-4872-8f91-926d32da2606 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f8db193d924987b1bfb460e1091ba2)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:23.392957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068da170-fdb3-4872-8f91-926d32da2606 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:23.395445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 106/217] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:23 2022] GET /identity/v3/users/b4f8db193d924987b1bfb460e1091ba2 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:23.402084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbacda3-4175-4dac-9c50-1a50b380885e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:23.454814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:23.523814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbacda3-4175-4dac-9c50-1a50b380885e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:23.569288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb7a4-4798-4c88-ad4d-67c50c078a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:23.569976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb7a4-4798-4c88-ad4d-67c50c078a59 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.570294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb7a4-4798-4c88-ad4d-67c50c078a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.570626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb7a4-4798-4c88-ad4d-67c50c078a59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.573243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a2371-22c8-48ec-9dfe-e7c375448122 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.573532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a2371-22c8-48ec-9dfe-e7c375448122 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.573813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a2371-22c8-48ec-9dfe-e7c375448122 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.576765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 107/218] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:23.583512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b2a4a-7eb8-4e87-8b02-e80b149c9ca3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.583807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b2a4a-7eb8-4e87-8b02-e80b149c9ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.584140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b2a4a-7eb8-4e87-8b02-e80b149c9ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.603921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1e2b2a4a-7eb8-4e87-8b02-e80b149c9ca3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:23.605225 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1e2b2a4a-7eb8-4e87-8b02-e80b149c9ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:23.657680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb7a4-4798-4c88-ad4d-67c50c078a59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:23.659240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb7a4-4798-4c88-ad4d-67c50c078a59 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:23.697964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 108/219] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:23.711446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:23.718536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b2a4a-7eb8-4e87-8b02-e80b149c9ca3 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:23.826856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:23.829511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 112/220] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:23.834840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb7a4-4798-4c88-ad4d-67c50c078a59 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:23.850764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b2a4a-7eb8-4e87-8b02-e80b149c9ca3 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:23.888070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f5a6a-a131-4756-97d5-c2721feec72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:23.903405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f5a6a-a131-4756-97d5-c2721feec72b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.903700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f5a6a-a131-4756-97d5-c2721feec72b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.903982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f5a6a-a131-4756-97d5-c2721feec72b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.916426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f5a6a-a131-4756-97d5-c2721feec72b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-ca9f5a6a-a131-4756-97d5-c2721feec72b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:23.924987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:23.925894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:23.927374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 109/221] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:32:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:23.932539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f5a6a-a131-4756-97d5-c2721feec72b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:24.042216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f5a6a-a131-4756-97d5-c2721feec72b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:24.078650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c3b42-e498-4793-874f-e8ff26c46ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:24.079332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c3b42-e498-4793-874f-e8ff26c46ce8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.079616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c3b42-e498-4793-874f-e8ff26c46ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.080071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c3b42-e498-4793-874f-e8ff26c46ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.080878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c3b42-e498-4793-874f-e8ff26c46ce8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:24.081189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c3b42-e498-4793-874f-e8ff26c46ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:24.083478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c3b42-e498-4793-874f-e8ff26c46ce8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:24.089418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:24.099075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 110/222] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:24.099075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743680-b104-4199-a5cc-8030f0df054d None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.099075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743680-b104-4199-a5cc-8030f0df054d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.099075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743680-b104-4199-a5cc-8030f0df054d None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.099075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 111/223] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:24.106456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00743680-b104-4199-a5cc-8030f0df054d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:24.126193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb7a4-4798-4c88-ad4d-67c50c078a59 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:24.168281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a5769-24c7-4615-a5a9-40adea45e38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:24.169415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a5769-24c7-4615-a5a9-40adea45e38e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.169878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a5769-24c7-4615-a5a9-40adea45e38e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.170319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a5769-24c7-4615-a5a9-40adea45e38e None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.172583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a5769-24c7-4615-a5a9-40adea45e38e None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:24.175087 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a5769-24c7-4615-a5a9-40adea45e38e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:24.178203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 113/224] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:23 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:24.179910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790a99-f60e-4bfd-a353-c2b13c7678b7 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.180322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790a99-f60e-4bfd-a353-c2b13c7678b7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.180719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790a99-f60e-4bfd-a353-c2b13c7678b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.202435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-42790a99-f60e-4bfd-a353-c2b13c7678b7 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:24.203874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-42790a99-f60e-4bfd-a353-c2b13c7678b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:24.206802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:24.234704 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00743680-b104-4199-a5cc-8030f0df054d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:24.281257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984e91d-d33e-4d4c-bdaa-28e0266c0faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:24.282662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e91d-d33e-4d4c-bdaa-28e0266c0faa None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.283167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e91d-d33e-4d4c-bdaa-28e0266c0faa None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.283636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e91d-d33e-4d4c-bdaa-28e0266c0faa None admin] PATH_INFO: `/v3/users/ada4fae1332f4f1b98ede70d2e0a899b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.285232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984e91d-d33e-4d4c-bdaa-28e0266c0faa None admin] RBAC: Authorizing `identity:get_user(user_id=ada4fae1332f4f1b98ede70d2e0a899b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:24.286905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984e91d-d33e-4d4c-bdaa-28e0266c0faa None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:24.289058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 112/225] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:24 2022] GET /identity/v3/users/ada4fae1332f4f1b98ede70d2e0a899b => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:24.290034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984e91d-d33e-4d4c-bdaa-28e0266c0faa None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:24.294172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 114/226] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:24.301957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42790a99-f60e-4bfd-a353-c2b13c7678b7 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:24.397297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:24.437580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42790a99-f60e-4bfd-a353-c2b13c7678b7 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:24.442714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984e91d-d33e-4d4c-bdaa-28e0266c0faa None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:24.479929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ce05d-b9e0-40d4-93d2-cfe5fb1476fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:24.480125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741944-6e23-46dc-9202-27bdb3df5390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:24.481095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741944-6e23-46dc-9202-27bdb3df5390 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.481480 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce05d-b9e0-40d4-93d2-cfe5fb1476fd None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.481592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741944-6e23-46dc-9202-27bdb3df5390 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.482074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741944-6e23-46dc-9202-27bdb3df5390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.482815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce05d-b9e0-40d4-93d2-cfe5fb1476fd None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.483278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce05d-b9e0-40d4-93d2-cfe5fb1476fd None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.483542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac741944-6e23-46dc-9202-27bdb3df5390 None admin] RBAC: Adding query filter params (role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=d88de896b4844391a04f85a2cc39591b, user.id=b4f8db193d924987b1bfb460e1091ba2) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:24.483867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac741944-6e23-46dc-9202-27bdb3df5390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:24.485063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ce05d-b9e0-40d4-93d2-cfe5fb1476fd None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:24.485432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac741944-6e23-46dc-9202-27bdb3df5390 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:24.486945 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ce05d-b9e0-40d4-93d2-cfe5fb1476fd None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:24.489931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 115/227] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:24 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:24.490926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ce05d-b9e0-40d4-93d2-cfe5fb1476fd None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:24.491287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 113/228] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:24 2022] GET /identity/v3/role_assignments?user.id=b4f8db193d924987b1bfb460e1091ba2&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:24.500763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:24.502767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741944-6e23-46dc-9202-27bdb3df5390 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:24.613218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ce05d-b9e0-40d4-93d2-cfe5fb1476fd None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:24.655990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821195-96bc-418c-97ef-53c4f1536b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:24.657340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821195-96bc-418c-97ef-53c4f1536b4d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.657824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821195-96bc-418c-97ef-53c4f1536b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.658328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821195-96bc-418c-97ef-53c4f1536b4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.694681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62821195-96bc-418c-97ef-53c4f1536b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-62821195-96bc-418c-97ef-53c4f1536b4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:24.703151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:24.704076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:24.704862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 116/229] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:24.714383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821195-96bc-418c-97ef-53c4f1536b4d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:24.723794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741944-6e23-46dc-9202-27bdb3df5390 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:24.765871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:24.773070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848c14-96e8-4e3d-b831-0095e3522d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:24.774282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848c14-96e8-4e3d-b831-0095e3522d7e None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.775327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848c14-96e8-4e3d-b831-0095e3522d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.775807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848c14-96e8-4e3d-b831-0095e3522d7e None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b/users/ada4fae1332f4f1b98ede70d2e0a899b/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.778884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8848c14-96e8-4e3d-b831-0095e3522d7e None admin] RBAC: Authorizing `identity:create_grant(project_id=d88de896b4844391a04f85a2cc39591b, user_id=ada4fae1332f4f1b98ede70d2e0a899b, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:24.780882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8848c14-96e8-4e3d-b831-0095e3522d7e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:24.809334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:24.850624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821195-96bc-418c-97ef-53c4f1536b4d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:24.887851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4197a-1803-4d5d-b042-fb4be1264eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:24.908686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 114/230] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:32:24 2022] PUT /identity/v3/projects/d88de896b4844391a04f85a2cc39591b/users/ada4fae1332f4f1b98ede70d2e0a899b/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:24.910130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4197a-1803-4d5d-b042-fb4be1264eef None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.910673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4197a-1803-4d5d-b042-fb4be1264eef None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.911146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4197a-1803-4d5d-b042-fb4be1264eef None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.912231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4197a-1803-4d5d-b042-fb4be1264eef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:24.912767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4197a-1803-4d5d-b042-fb4be1264eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:24.914700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4197a-1803-4d5d-b042-fb4be1264eef None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:24.926220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 117/231] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:24.939800 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848c14-96e8-4e3d-b831-0095e3522d7e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:25.049912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848c14-96e8-4e3d-b831-0095e3522d7e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:25.087513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038478c-463b-4e1b-8523-8b5588b20a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:25.088793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038478c-463b-4e1b-8523-8b5588b20a0d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:25.089277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038478c-463b-4e1b-8523-8b5588b20a0d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:25.089765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038478c-463b-4e1b-8523-8b5588b20a0d None admin] PATH_INFO: `/v3/users/ada4fae1332f4f1b98ede70d2e0a899b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:25.091319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038478c-463b-4e1b-8523-8b5588b20a0d None admin] RBAC: Authorizing `identity:get_user(user_id=ada4fae1332f4f1b98ede70d2e0a899b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:25.093555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038478c-463b-4e1b-8523-8b5588b20a0d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:25.095498 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 115/232] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:24 2022] GET /identity/v3/users/ada4fae1332f4f1b98ede70d2e0a899b => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:25.103052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4197a-1803-4d5d-b042-fb4be1264eef None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:25.215548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4197a-1803-4d5d-b042-fb4be1264eef None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:25.245063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:25.254144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c77f55-6e71-4fab-8135-033e57ce27fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:25.255354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c77f55-6e71-4fab-8135-033e57ce27fe None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:25.255837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c77f55-6e71-4fab-8135-033e57ce27fe None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:25.256321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c77f55-6e71-4fab-8135-033e57ce27fe None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:25.257743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c77f55-6e71-4fab-8135-033e57ce27fe None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:25.259613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c77f55-6e71-4fab-8135-033e57ce27fe None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:25.261558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 118/233] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:25 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:25.268608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038478c-463b-4e1b-8523-8b5588b20a0d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:25.334035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:25.378146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038478c-463b-4e1b-8523-8b5588b20a0d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:25.422790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2bd8-c0c5-4b41-9df5-ab70b6796df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:25.423693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2bd8-c0c5-4b41-9df5-ab70b6796df1 None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:25.423979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2bd8-c0c5-4b41-9df5-ab70b6796df1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:25.424254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2bd8-c0c5-4b41-9df5-ab70b6796df1 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b/users/ada4fae1332f4f1b98ede70d2e0a899b/roles/a49601657f8b4e909b0a9b2adb444573` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:25.432539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2bd8-c0c5-4b41-9df5-ab70b6796df1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d88de896b4844391a04f85a2cc39591b, user_id=ada4fae1332f4f1b98ede70d2e0a899b, role_id=a49601657f8b4e909b0a9b2adb444573)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:25.434043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2bd8-c0c5-4b41-9df5-ab70b6796df1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:25.561203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 116/234] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:32:25 2022] PUT /identity/v3/projects/d88de896b4844391a04f85a2cc39591b/users/ada4fae1332f4f1b98ede70d2e0a899b/roles/a49601657f8b4e909b0a9b2adb444573 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:25.825169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95211c8b-f60c-4275-8f91-7fb829dead50 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:25.826731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95211c8b-f60c-4275-8f91-7fb829dead50 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:25.827226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95211c8b-f60c-4275-8f91-7fb829dead50 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:25.829055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 119/235] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:25.837752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dc030-5d9c-467c-880a-cfdf743a5412 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:25.838387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dc030-5d9c-467c-880a-cfdf743a5412 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:25.838868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dc030-5d9c-467c-880a-cfdf743a5412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:25.859726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c56dc030-5d9c-467c-880a-cfdf743a5412 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:25.861268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c56dc030-5d9c-467c-880a-cfdf743a5412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:25.878594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596a5c-25c7-4ea1-9c4b-9eb20fb28891 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:25.879185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596a5c-25c7-4ea1-9c4b-9eb20fb28891 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:25.879662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596a5c-25c7-4ea1-9c4b-9eb20fb28891 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:25.881484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 120/236] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:25.886030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58473-ed31-4099-8201-cae4e27f26b1 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:25.886571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58473-ed31-4099-8201-cae4e27f26b1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:25.887054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58473-ed31-4099-8201-cae4e27f26b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:25.916377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-2cc58473-ed31-4099-8201-cae4e27f26b1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:25.918174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2cc58473-ed31-4099-8201-cae4e27f26b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:26.005960 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 117/237] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:26.043319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 121/238] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:26.047802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dc030-5d9c-467c-880a-cfdf743a5412 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:26.075254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58473-ed31-4099-8201-cae4e27f26b1 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:26.143017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:26.198587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58473-ed31-4099-8201-cae4e27f26b1 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:26.238496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dc030-5d9c-467c-880a-cfdf743a5412 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:26.260478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:26.266107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9eec9-fa76-4d0a-b341-aa3c3d39a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:26.266908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9eec9-fa76-4d0a-b341-aa3c3d39a643 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:26.267190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9eec9-fa76-4d0a-b341-aa3c3d39a643 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:26.267465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9eec9-fa76-4d0a-b341-aa3c3d39a643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:26.269733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9eec9-fa76-4d0a-b341-aa3c3d39a643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:26.271239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9eec9-fa76-4d0a-b341-aa3c3d39a643 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:26.272853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 122/239] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:26.278097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9eec9-fa76-4d0a-b341-aa3c3d39a643 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:26.317629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26efa6-696b-49c0-8942-73df9120829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:26.318460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26efa6-696b-49c0-8942-73df9120829a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:26.318743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26efa6-696b-49c0-8942-73df9120829a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:26.319071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26efa6-696b-49c0-8942-73df9120829a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:26.344820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26efa6-696b-49c0-8942-73df9120829a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-fe26efa6-696b-49c0-8942-73df9120829a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:26.352703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:26.353620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:26.354898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 118/240] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:26.363089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26efa6-696b-49c0-8942-73df9120829a None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:26.387707 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9eec9-fa76-4d0a-b341-aa3c3d39a643 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:26.423551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cad6e-4ace-4983-9d1e-d77fd01d7474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:26.424232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cad6e-4ace-4983-9d1e-d77fd01d7474 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:26.424523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cad6e-4ace-4983-9d1e-d77fd01d7474 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:26.424807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cad6e-4ace-4983-9d1e-d77fd01d7474 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:26.425536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cad6e-4ace-4983-9d1e-d77fd01d7474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:26.427110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cad6e-4ace-4983-9d1e-d77fd01d7474 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:26.534065 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 123/241] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:26 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:32:26.590034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26efa6-696b-49c0-8942-73df9120829a None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:26.622487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:26.681103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca97693-6590-4dac-8844-28275344f70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:26.681802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97693-6590-4dac-8844-28275344f70c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:26.682109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97693-6590-4dac-8844-28275344f70c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:26.682390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97693-6590-4dac-8844-28275344f70c None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:26.683166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca97693-6590-4dac-8844-28275344f70c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:26.683476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca97693-6590-4dac-8844-28275344f70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:26.684889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca97693-6590-4dac-8844-28275344f70c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:26.701537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 119/242] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:26.715389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cad6e-4ace-4983-9d1e-d77fd01d7474 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:26.834162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:26.913176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cad6e-4ace-4983-9d1e-d77fd01d7474 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:26.964092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814d045-8596-482f-a84a-a7d4da0d4934 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:26.964866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814d045-8596-482f-a84a-a7d4da0d4934 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:26.965344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814d045-8596-482f-a84a-a7d4da0d4934 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:26.967919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 120/243] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:26.976641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9fe8-964e-4023-b3e1-bcd1f5ea3bb1 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:26.977260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9fe8-964e-4023-b3e1-bcd1f5ea3bb1 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:26.977734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9fe8-964e-4023-b3e1-bcd1f5ea3bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:26.991728 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38353e-19d4-49c4-97e7-0246e02a3ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:26.992623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38353e-19d4-49c4-97e7-0246e02a3ef2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:26.992906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38353e-19d4-49c4-97e7-0246e02a3ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:26.993187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38353e-19d4-49c4-97e7-0246e02a3ef2 None admin] PATH_INFO: `/v3/users/9a7eb1a4cbf94ca1885206a3e0b55754` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:27.009969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38353e-19d4-49c4-97e7-0246e02a3ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=9a7eb1a4cbf94ca1885206a3e0b55754)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:27.011019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38353e-19d4-49c4-97e7-0246e02a3ef2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:27.017821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 124/244] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:26 2022] GET /identity/v3/users/9a7eb1a4cbf94ca1885206a3e0b55754 => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:27.019527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38353e-19d4-49c4-97e7-0246e02a3ef2 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:27.026940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-935f9fe8-964e-4023-b3e1-bcd1f5ea3bb1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:27.028715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-935f9fe8-964e-4023-b3e1-bcd1f5ea3bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:27.143411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38353e-19d4-49c4-97e7-0246e02a3ef2 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:27.146678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 121/245] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:27.153926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:27.171005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9fe8-964e-4023-b3e1-bcd1f5ea3bb1 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:27.180413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513288-8e5a-4ac6-88d9-d8f1b38c7953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:27.181081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513288-8e5a-4ac6-88d9-d8f1b38c7953 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:27.181431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513288-8e5a-4ac6-88d9-d8f1b38c7953 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:27.181716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513288-8e5a-4ac6-88d9-d8f1b38c7953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:27.268749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513288-8e5a-4ac6-88d9-d8f1b38c7953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:27.270396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513288-8e5a-4ac6-88d9-d8f1b38c7953 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:27.294099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9fe8-964e-4023-b3e1-bcd1f5ea3bb1 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:27.295824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:27.334264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc85afc-2538-4a6d-8dfa-ec37cb9a642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:27.335176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc85afc-2538-4a6d-8dfa-ec37cb9a642e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:27.335466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc85afc-2538-4a6d-8dfa-ec37cb9a642e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:27.335741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc85afc-2538-4a6d-8dfa-ec37cb9a642e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:27.349077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc85afc-2538-4a6d-8dfa-ec37cb9a642e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-0bc85afc-2538-4a6d-8dfa-ec37cb9a642e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:27.357682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:27.358674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:27.359456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 122/246] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:27.365107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc85afc-2538-4a6d-8dfa-ec37cb9a642e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:27.384308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 125/247] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:32:27.390220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513288-8e5a-4ac6-88d9-d8f1b38c7953 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:27.400967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:27.475695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc85afc-2538-4a6d-8dfa-ec37cb9a642e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:27.512829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1733c-7f63-4c5e-8d3f-597c9c4e571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:27.513539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1733c-7f63-4c5e-8d3f-597c9c4e571b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:27.513828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1733c-7f63-4c5e-8d3f-597c9c4e571b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:27.514138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1733c-7f63-4c5e-8d3f-597c9c4e571b None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:27.515013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1733c-7f63-4c5e-8d3f-597c9c4e571b None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:27.515428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1733c-7f63-4c5e-8d3f-597c9c4e571b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:27.516828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1733c-7f63-4c5e-8d3f-597c9c4e571b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:27.530369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 123/248] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:27.531857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1733c-7f63-4c5e-8d3f-597c9c4e571b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:27.532056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513288-8e5a-4ac6-88d9-d8f1b38c7953 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:27.559686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:27.573252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaf3ca-202c-46cd-8e54-8a4ba3e79c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:27.574384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaf3ca-202c-46cd-8e54-8a4ba3e79c0c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:27.574820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaf3ca-202c-46cd-8e54-8a4ba3e79c0c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:27.575247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaf3ca-202c-46cd-8e54-8a4ba3e79c0c None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:27.576849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaf3ca-202c-46cd-8e54-8a4ba3e79c0c None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:27.578503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaf3ca-202c-46cd-8e54-8a4ba3e79c0c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:27.580658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 126/249] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:27 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:27.586428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaf3ca-202c-46cd-8e54-8a4ba3e79c0c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:27.645184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1733c-7f63-4c5e-8d3f-597c9c4e571b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:27.673998 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:27.683459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587508d6-b91d-4552-a8df-840f2de94e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:27.684542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587508d6-b91d-4552-a8df-840f2de94e8a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:27.685000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587508d6-b91d-4552-a8df-840f2de94e8a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:27.686105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587508d6-b91d-4552-a8df-840f2de94e8a None admin] PATH_INFO: `/v3/users/b4f8db193d924987b1bfb460e1091ba2` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:27.687570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587508d6-b91d-4552-a8df-840f2de94e8a None admin] RBAC: Authorizing `identity:get_user(user_id=b4f8db193d924987b1bfb460e1091ba2)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:27.689447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587508d6-b91d-4552-a8df-840f2de94e8a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:27.691628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 124/250] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:27 2022] GET /identity/v3/users/b4f8db193d924987b1bfb460e1091ba2 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:27.697320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587508d6-b91d-4552-a8df-840f2de94e8a None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:27.713175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaf3ca-202c-46cd-8e54-8a4ba3e79c0c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:27.774761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f05f0-768d-4cf8-8ebe-6bee18f7dee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:27.775342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f05f0-768d-4cf8-8ebe-6bee18f7dee6 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:27.775631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f05f0-768d-4cf8-8ebe-6bee18f7dee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:27.775914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f05f0-768d-4cf8-8ebe-6bee18f7dee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:27.776762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f05f0-768d-4cf8-8ebe-6bee18f7dee6 None admin] RBAC: Adding query filter params (role.id=cfb149781a404c6892fa0ff5b015482d, scope.project.id=d88de896b4844391a04f85a2cc39591b, user.id=9a7eb1a4cbf94ca1885206a3e0b55754) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:27.777083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f05f0-768d-4cf8-8ebe-6bee18f7dee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:27.778591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f05f0-768d-4cf8-8ebe-6bee18f7dee6 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:27.792165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 127/251] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:27 2022] GET /identity/v3/role_assignments?user.id=9a7eb1a4cbf94ca1885206a3e0b55754&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=cfb149781a404c6892fa0ff5b015482d => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:27.798198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:27.808734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587508d6-b91d-4552-a8df-840f2de94e8a None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:27.847840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4cd15-3cdd-49a3-a447-11629b9f5acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:27.848989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4cd15-3cdd-49a3-a447-11629b9f5acd None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:27.849423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4cd15-3cdd-49a3-a447-11629b9f5acd None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:27.850190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4cd15-3cdd-49a3-a447-11629b9f5acd None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:27.851686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4cd15-3cdd-49a3-a447-11629b9f5acd None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:27.853371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4cd15-3cdd-49a3-a447-11629b9f5acd None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:27.855974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 125/252] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:27 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:27.862475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f05f0-768d-4cf8-8ebe-6bee18f7dee6 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:27.985832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f05f0-768d-4cf8-8ebe-6bee18f7dee6 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:28.030143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5eb88-1734-40df-a165-e3ae2e431911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:28.031407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5eb88-1734-40df-a165-e3ae2e431911 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:28.031894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5eb88-1734-40df-a165-e3ae2e431911 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:28.032369 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5eb88-1734-40df-a165-e3ae2e431911 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b/users/b4f8db193d924987b1bfb460e1091ba2/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:28.034631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5eb88-1734-40df-a165-e3ae2e431911 None admin] RBAC: Authorizing `identity:create_grant(project_id=d88de896b4844391a04f85a2cc39591b, user_id=b4f8db193d924987b1bfb460e1091ba2, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:28.036423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5eb88-1734-40df-a165-e3ae2e431911 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:28.062982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f414459-4662-41d4-9e9b-fb3e7389694b None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:28.063990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f414459-4662-41d4-9e9b-fb3e7389694b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:28.064492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f414459-4662-41d4-9e9b-fb3e7389694b None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:28.066348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 126/253] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:28.071700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe806c-1dc2-43a9-8916-e49a8b419d85 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:28.072299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe806c-1dc2-43a9-8916-e49a8b419d85 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:28.072782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe806c-1dc2-43a9-8916-e49a8b419d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:28.090716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-d0fe806c-1dc2-43a9-8916-e49a8b419d85 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:28.092756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d0fe806c-1dc2-43a9-8916-e49a8b419d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:28.122987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:28.127530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 128/254] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:32:27 2022] PUT /identity/v3/projects/d88de896b4844391a04f85a2cc39591b/users/b4f8db193d924987b1bfb460e1091ba2/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:28.177307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 127/255] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:28.201858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5eb88-1734-40df-a165-e3ae2e431911 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:28.329433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5eb88-1734-40df-a165-e3ae2e431911 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:28.365788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab2306-66c9-4c4e-9a37-4e307f36a3b9 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:28.366136 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab2306-66c9-4c4e-9a37-4e307f36a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:28.366399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab2306-66c9-4c4e-9a37-4e307f36a3b9 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:28.368249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 128/256] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:28.373513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221f0a-1308-4e89-a91d-392276f963c1 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:28.373812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221f0a-1308-4e89-a91d-392276f963c1 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:28.374127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221f0a-1308-4e89-a91d-392276f963c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:28.399009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a5221f0a-1308-4e89-a91d-392276f963c1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:28.399197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eb3d2-a985-49e5-8972-c86fad4b407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:28.399899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eb3d2-a985-49e5-8972-c86fad4b407d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:28.400186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eb3d2-a985-49e5-8972-c86fad4b407d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:28.400287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a5221f0a-1308-4e89-a91d-392276f963c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:28.400466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eb3d2-a985-49e5-8972-c86fad4b407d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:28.414961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181eb3d2-a985-49e5-8972-c86fad4b407d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-181eb3d2-a985-49e5-8972-c86fad4b407d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:28.424904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:28.425784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:28.426642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:28.427247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 129/257] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:28.433978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eb3d2-a985-49e5-8972-c86fad4b407d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:28.486532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 129/258] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:28.527079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:28.543403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5221f0a-1308-4e89-a91d-392276f963c1 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:28.571272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eb3d2-a985-49e5-8972-c86fad4b407d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:28.578325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:28.644071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988ee0b-0c57-4efc-be4a-9de3dbc30c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:28.644776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988ee0b-0c57-4efc-be4a-9de3dbc30c95 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:28.645067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988ee0b-0c57-4efc-be4a-9de3dbc30c95 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:28.645399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988ee0b-0c57-4efc-be4a-9de3dbc30c95 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:28.646251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988ee0b-0c57-4efc-be4a-9de3dbc30c95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:28.646665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988ee0b-0c57-4efc-be4a-9de3dbc30c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:28.648253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988ee0b-0c57-4efc-be4a-9de3dbc30c95 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:28.665159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 130/259] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:28.670767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988ee0b-0c57-4efc-be4a-9de3dbc30c95 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:28.772122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5221f0a-1308-4e89-a91d-392276f963c1 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:28.836392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1151-f5d9-42d9-88bc-4df397e2b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:28.837212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1151-f5d9-42d9-88bc-4df397e2b430 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:28.837494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1151-f5d9-42d9-88bc-4df397e2b430 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:28.837766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1151-f5d9-42d9-88bc-4df397e2b430 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:28.856918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988ee0b-0c57-4efc-be4a-9de3dbc30c95 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:28.862014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a1151-f5d9-42d9-88bc-4df397e2b430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-334a1151-f5d9-42d9-88bc-4df397e2b430 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:28.878297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:28.879207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:28.879976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 130/260] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:28.889379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1151-f5d9-42d9-88bc-4df397e2b430 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:28.925601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:28.948075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852beda8-99d7-4752-85df-87622b25fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:28.949353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852beda8-99d7-4752-85df-87622b25fe29 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:28.950493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852beda8-99d7-4752-85df-87622b25fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:28.951660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852beda8-99d7-4752-85df-87622b25fe29 None admin] PATH_INFO: `/v3/users/ada4fae1332f4f1b98ede70d2e0a899b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:28.956624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852beda8-99d7-4752-85df-87622b25fe29 None admin] RBAC: Authorizing `identity:get_user(user_id=ada4fae1332f4f1b98ede70d2e0a899b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:28.958750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852beda8-99d7-4752-85df-87622b25fe29 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:28.962205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 131/261] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:28 2022] GET /identity/v3/users/ada4fae1332f4f1b98ede70d2e0a899b => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:28.977371 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852beda8-99d7-4752-85df-87622b25fe29 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:29.106335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:29.116047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852beda8-99d7-4752-85df-87622b25fe29 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:29.164143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1151-f5d9-42d9-88bc-4df397e2b430 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:29.179518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b4a1d-5142-4f9e-a5a8-866c6d6f37d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:29.180187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b4a1d-5142-4f9e-a5a8-866c6d6f37d8 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:29.180473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b4a1d-5142-4f9e-a5a8-866c6d6f37d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:29.180750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b4a1d-5142-4f9e-a5a8-866c6d6f37d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:29.247138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad1b4e-40c3-48e8-b64e-6653ca3866c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:29.248429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad1b4e-40c3-48e8-b64e-6653ca3866c9 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:29.248725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad1b4e-40c3-48e8-b64e-6653ca3866c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:29.249010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad1b4e-40c3-48e8-b64e-6653ca3866c9 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:29.249854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad1b4e-40c3-48e8-b64e-6653ca3866c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:29.250206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad1b4e-40c3-48e8-b64e-6653ca3866c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:29.251676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad1b4e-40c3-48e8-b64e-6653ca3866c9 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:29.275128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 131/262] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:29.281066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad1b4e-40c3-48e8-b64e-6653ca3866c9 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:29.305120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:29.326770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b4a1d-5142-4f9e-a5a8-866c6d6f37d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:29.332384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b4a1d-5142-4f9e-a5a8-866c6d6f37d8 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:29.520289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad1b4e-40c3-48e8-b64e-6653ca3866c9 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:29.521432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 132/263] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:32:29.528064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b4a1d-5142-4f9e-a5a8-866c6d6f37d8 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:29.593462 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6462532-a770-4c02-afd0-50cb6a153e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:29.594376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6462532-a770-4c02-afd0-50cb6a153e70 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:29.594665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6462532-a770-4c02-afd0-50cb6a153e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:29.594944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6462532-a770-4c02-afd0-50cb6a153e70 None admin] PATH_INFO: `/v3/users/ada4fae1332f4f1b98ede70d2e0a899b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:29.596166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6462532-a770-4c02-afd0-50cb6a153e70 None admin] RBAC: Authorizing `identity:get_user(user_id=ada4fae1332f4f1b98ede70d2e0a899b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:29.601971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6462532-a770-4c02-afd0-50cb6a153e70 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:29.601971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 132/264] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:29 2022] GET /identity/v3/users/ada4fae1332f4f1b98ede70d2e0a899b => generated 283 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:29.606999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6462532-a770-4c02-afd0-50cb6a153e70 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:29.633435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:29.693473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:29.714031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b4a1d-5142-4f9e-a5a8-866c6d6f37d8 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:29.786905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb26e5-df48-40e0-99b1-5b4169771345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:29.787776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb26e5-df48-40e0-99b1-5b4169771345 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:29.788061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb26e5-df48-40e0-99b1-5b4169771345 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:29.788334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb26e5-df48-40e0-99b1-5b4169771345 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:29.791814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb26e5-df48-40e0-99b1-5b4169771345 None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:29.793414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb26e5-df48-40e0-99b1-5b4169771345 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:29.795719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 133/265] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:29 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:29.801591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb26e5-df48-40e0-99b1-5b4169771345 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:29.840054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6462532-a770-4c02-afd0-50cb6a153e70 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:29.943235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbda1-4d45-4ccf-a181-8957449b4253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:29.943909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbda1-4d45-4ccf-a181-8957449b4253 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:29.944198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbda1-4d45-4ccf-a181-8957449b4253 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:29.944481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbda1-4d45-4ccf-a181-8957449b4253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:29.956136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb26e5-df48-40e0-99b1-5b4169771345 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:30.001395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa18e4-3f0b-40ce-b4cb-b57e6179d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:30.002089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa18e4-3f0b-40ce-b4cb-b57e6179d1ac None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.002371 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa18e4-3f0b-40ce-b4cb-b57e6179d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.002645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa18e4-3f0b-40ce-b4cb-b57e6179d1ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.003488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa18e4-3f0b-40ce-b4cb-b57e6179d1ac None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=d88de896b4844391a04f85a2cc39591b, user.id=ada4fae1332f4f1b98ede70d2e0a899b) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:30.003799 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa18e4-3f0b-40ce-b4cb-b57e6179d1ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:30.005255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa18e4-3f0b-40ce-b4cb-b57e6179d1ac None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:30.024405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 134/266] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:29 2022] GET /identity/v3/role_assignments?user.id=ada4fae1332f4f1b98ede70d2e0a899b&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:30.079181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdbda1-4d45-4ccf-a181-8957449b4253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:30.081702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdbda1-4d45-4ccf-a181-8957449b4253 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:30.101666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:30.128717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a63cb-99cc-419d-b9d8-f2a784e6062b None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.129051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a63cb-99cc-419d-b9d8-f2a784e6062b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.129269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a63cb-99cc-419d-b9d8-f2a784e6062b None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.130733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 135/267] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:30.137572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1060e-d592-4227-bddf-2fcd18033c35 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.137888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1060e-d592-4227-bddf-2fcd18033c35 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.138831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1060e-d592-4227-bddf-2fcd18033c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.163203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-31c1060e-d592-4227-bddf-2fcd18033c35 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:30.164435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-31c1060e-d592-4227-bddf-2fcd18033c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:30.194323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:30.292913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 133/268] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:32:30.298152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbda1-4d45-4ccf-a181-8957449b4253 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:30.305527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 136/269] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:30.333597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1060e-d592-4227-bddf-2fcd18033c35 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:30.439120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1060e-d592-4227-bddf-2fcd18033c35 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:30.443961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbda1-4d45-4ccf-a181-8957449b4253 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:30.456239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:30.475267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db955c9-32ed-4bb0-931f-91c00784a2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:30.477878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db955c9-32ed-4bb0-931f-91c00784a2ff None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.477878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db955c9-32ed-4bb0-931f-91c00784a2ff None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.477878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db955c9-32ed-4bb0-931f-91c00784a2ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.477878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db955c9-32ed-4bb0-931f-91c00784a2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:30.479646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db955c9-32ed-4bb0-931f-91c00784a2ff None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:30.480558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf1e6a-2ecd-4ac5-b04c-80255be7b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:30.481275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 137/270] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:30.481753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf1e6a-2ecd-4ac5-b04c-80255be7b318 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.482595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf1e6a-2ecd-4ac5-b04c-80255be7b318 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.482872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf1e6a-2ecd-4ac5-b04c-80255be7b318 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.484211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf1e6a-2ecd-4ac5-b04c-80255be7b318 None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:30.485658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf1e6a-2ecd-4ac5-b04c-80255be7b318 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:30.486820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729ef0-f77b-4795-b032-d823f4c3cdea None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.487178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729ef0-f77b-4795-b032-d823f4c3cdea None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.487466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729ef0-f77b-4795-b032-d823f4c3cdea None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.488776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 138/272] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:30.490395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729ef0-f77b-4795-b032-d823f4c3cdea None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:30.492249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 134/272] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:30 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:30.493527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf1e6a-2ecd-4ac5-b04c-80255be7b318 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:30.515072 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:30.614029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf1e6a-2ecd-4ac5-b04c-80255be7b318 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:30.627698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729ef0-f77b-4795-b032-d823f4c3cdea None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:30.649418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293c023-25db-4c43-9641-6d3292ebb3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:30.650116 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293c023-25db-4c43-9641-6d3292ebb3b1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.650412 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293c023-25db-4c43-9641-6d3292ebb3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.650696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293c023-25db-4c43-9641-6d3292ebb3b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.651559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293c023-25db-4c43-9641-6d3292ebb3b1 None admin] RBAC: Adding query filter params (role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=d88de896b4844391a04f85a2cc39591b, user.id=ada4fae1332f4f1b98ede70d2e0a899b) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:30.651856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293c023-25db-4c43-9641-6d3292ebb3b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:30.653322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293c023-25db-4c43-9641-6d3292ebb3b1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:30.659487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 135/273] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:30 2022] GET /identity/v3/role_assignments?user.id=ada4fae1332f4f1b98ede70d2e0a899b&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:30.660681 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9ba88-8a53-451b-b0ac-c46e84fc49c9 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.660973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9ba88-8a53-451b-b0ac-c46e84fc49c9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.661255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9ba88-8a53-451b-b0ac-c46e84fc49c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.681070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e4d9ba88-8a53-451b-b0ac-c46e84fc49c9 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:30.682320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e4d9ba88-8a53-451b-b0ac-c46e84fc49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:30.685604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb0902-dd9b-40c0-96df-58efa40596a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:30.687574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb0902-dd9b-40c0-96df-58efa40596a1 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.688064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb0902-dd9b-40c0-96df-58efa40596a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.688522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb0902-dd9b-40c0-96df-58efa40596a1 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.689449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb0902-dd9b-40c0-96df-58efa40596a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:30.691229 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb0902-dd9b-40c0-96df-58efa40596a1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:30.723705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:30.760817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 136/274] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:30.762620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffec8dc-3317-4551-b2f5-6985632e5db5 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.763153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffec8dc-3317-4551-b2f5-6985632e5db5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.763635 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffec8dc-3317-4551-b2f5-6985632e5db5 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.765221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 137/275] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:30.773233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b962-f794-4bae-a55d-28b812d8fece None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:30.773852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b962-f794-4bae-a55d-28b812d8fece None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:30.774378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b962-f794-4bae-a55d-28b812d8fece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:30.787001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 139/276] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:30 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:30.795857 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb0902-dd9b-40c0-96df-58efa40596a1 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:30.801598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9b90b962-f794-4bae-a55d-28b812d8fece None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:30.803119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9b90b962-f794-4bae-a55d-28b812d8fece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:30.919195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 138/277] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:30.943856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:30.944401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b962-f794-4bae-a55d-28b812d8fece None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:30.983702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb0902-dd9b-40c0-96df-58efa40596a1 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.028319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af778-3605-4975-b3c6-511ecc645b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.030048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af778-3605-4975-b3c6-511ecc645b10 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.030716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af778-3605-4975-b3c6-511ecc645b10 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.031198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af778-3605-4975-b3c6-511ecc645b10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.048481 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59af778-3605-4975-b3c6-511ecc645b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-e59af778-3605-4975-b3c6-511ecc645b10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:31.057976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:31.058878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:31.059671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:31.062671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 140/278] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:31.069093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af778-3605-4975-b3c6-511ecc645b10 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:31.092829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b962-f794-4bae-a55d-28b812d8fece None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.095057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:31.141877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb2ea3-43fc-48da-bc57-172e9743c5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.143040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb2ea3-43fc-48da-bc57-172e9743c5f6 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.143477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb2ea3-43fc-48da-bc57-172e9743c5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.143760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb2ea3-43fc-48da-bc57-172e9743c5f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.156912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb2ea3-43fc-48da-bc57-172e9743c5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-3adb2ea3-43fc-48da-bc57-172e9743c5f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:31.164764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:31.165720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:31.166565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:31.167160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 139/279] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:31.173919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb2ea3-43fc-48da-bc57-172e9743c5f6 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:31.186794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af778-3605-4975-b3c6-511ecc645b10 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.231346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19b8d-1268-4899-9f1c-84e577fca882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.232636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19b8d-1268-4899-9f1c-84e577fca882 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.232894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19b8d-1268-4899-9f1c-84e577fca882 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.233169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19b8d-1268-4899-9f1c-84e577fca882 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.233927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe19b8d-1268-4899-9f1c-84e577fca882 None admin] RBAC: Adding query filter params (name=member) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:31.234732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe19b8d-1268-4899-9f1c-84e577fca882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:31.235649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe19b8d-1268-4899-9f1c-84e577fca882 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:31.239292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:31.247666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 141/280] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:31.252893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19b8d-1268-4899-9f1c-84e577fca882 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:31.301928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb2ea3-43fc-48da-bc57-172e9743c5f6 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.347356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830bfaa-8871-42e6-9607-e789f2bcd13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.348035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830bfaa-8871-42e6-9607-e789f2bcd13f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.348326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830bfaa-8871-42e6-9607-e789f2bcd13f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.348609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830bfaa-8871-42e6-9607-e789f2bcd13f None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.349371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830bfaa-8871-42e6-9607-e789f2bcd13f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:31.350335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830bfaa-8871-42e6-9607-e789f2bcd13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:31.351789 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830bfaa-8871-42e6-9607-e789f2bcd13f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:31.364080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 140/281] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:31.365628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae1c8f-a743-4a3c-9350-3d3114d584da None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.366464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae1c8f-a743-4a3c-9350-3d3114d584da None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.366852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae1c8f-a743-4a3c-9350-3d3114d584da None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.368882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 141/282] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:31.373394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae1c8f-a743-4a3c-9350-3d3114d584da None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:31.379030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19b8d-1268-4899-9f1c-84e577fca882 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.400829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:31.416574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e819ff-73bc-4635-a2a7-b90244c4ad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.416574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e819ff-73bc-4635-a2a7-b90244c4ad94 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.416574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e819ff-73bc-4635-a2a7-b90244c4ad94 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.416574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e819ff-73bc-4635-a2a7-b90244c4ad94 None admin] PATH_INFO: `/v3/users/92445179f79241fdb9be4e343e53e777` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.430762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e819ff-73bc-4635-a2a7-b90244c4ad94 None admin] RBAC: Authorizing `identity:get_user(user_id=92445179f79241fdb9be4e343e53e777)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:31.432554 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e819ff-73bc-4635-a2a7-b90244c4ad94 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:31.434867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 142/283] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:31 2022] GET /identity/v3/users/92445179f79241fdb9be4e343e53e777 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:31.436346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f7ee4-6ce2-42ae-81c6-a589dd093f41 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.436858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f7ee4-6ce2-42ae-81c6-a589dd093f41 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.437343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f7ee4-6ce2-42ae-81c6-a589dd093f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.454636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-280f7ee4-6ce2-42ae-81c6-a589dd093f41 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:31.456132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-280f7ee4-6ce2-42ae-81c6-a589dd093f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:31.484794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae1c8f-a743-4a3c-9350-3d3114d584da None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.518265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:31.521911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092e884-cd0e-4b67-816a-668398ffc263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.522879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092e884-cd0e-4b67-816a-668398ffc263 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.523168 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092e884-cd0e-4b67-816a-668398ffc263 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.523451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092e884-cd0e-4b67-816a-668398ffc263 None admin] PATH_INFO: `/v3/users/9a7eb1a4cbf94ca1885206a3e0b55754` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.524659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092e884-cd0e-4b67-816a-668398ffc263 None admin] RBAC: Authorizing `identity:get_user(user_id=9a7eb1a4cbf94ca1885206a3e0b55754)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:31.526255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092e884-cd0e-4b67-816a-668398ffc263 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:31.526520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 143/284] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:31.527589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f7ee4-6ce2-42ae-81c6-a589dd093f41 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:31.528067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 142/285] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:31 2022] GET /identity/v3/users/9a7eb1a4cbf94ca1885206a3e0b55754 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:31.535327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092e884-cd0e-4b67-816a-668398ffc263 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:31.640727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:31.650118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092e884-cd0e-4b67-816a-668398ffc263 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.652225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f7ee4-6ce2-42ae-81c6-a589dd093f41 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.684703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b46f1a-055b-4e62-858b-7d5b54ed7888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.686045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b46f1a-055b-4e62-858b-7d5b54ed7888 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.686336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b46f1a-055b-4e62-858b-7d5b54ed7888 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.686614 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b46f1a-055b-4e62-858b-7d5b54ed7888 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.687771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b46f1a-055b-4e62-858b-7d5b54ed7888 None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:31.689228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b46f1a-055b-4e62-858b-7d5b54ed7888 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:31.690815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae0221-9513-4350-8fbc-8dea5db15e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.691698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae0221-9513-4350-8fbc-8dea5db15e7e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.692208 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 143/286] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:31 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:31.692430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae0221-9513-4350-8fbc-8dea5db15e7e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.692999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae0221-9513-4350-8fbc-8dea5db15e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.693115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b46f1a-055b-4e62-858b-7d5b54ed7888 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:31.694214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae0221-9513-4350-8fbc-8dea5db15e7e None admin] RBAC: Adding query filter params (role.id=217ceb9b91034918b3bb34c38120ab4f, user.id=92445179f79241fdb9be4e343e53e777, scope.system=all) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:31.694729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae0221-9513-4350-8fbc-8dea5db15e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:31.696763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae0221-9513-4350-8fbc-8dea5db15e7e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:31.703125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 144/287] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 30 10:32:31 2022] GET /identity/v3/role_assignments?user.id=92445179f79241fdb9be4e343e53e777&scope.system=all&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:31.704318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae0221-9513-4350-8fbc-8dea5db15e7e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:31.760956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:31.804146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b46f1a-055b-4e62-858b-7d5b54ed7888 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.817867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae0221-9513-4350-8fbc-8dea5db15e7e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:31.842265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1d58b-88ed-4910-af16-a82052f61fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.843184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1d58b-88ed-4910-af16-a82052f61fec None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.843366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1d58b-88ed-4910-af16-a82052f61fec None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.843645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1d58b-88ed-4910-af16-a82052f61fec None admin] PATH_INFO: `/v3/roles/member` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.855596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1d58b-88ed-4910-af16-a82052f61fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-d2a1d58b-88ed-4910-af16-a82052f61fec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:31.863579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:31.864529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:31.865304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 144/288] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:31.871281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66187683-2f80-4f72-af1f-2f75b2796ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:31.871281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66187683-2f80-4f72-af1f-2f75b2796ea3 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:31.871281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66187683-2f80-4f72-af1f-2f75b2796ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:31.871281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66187683-2f80-4f72-af1f-2f75b2796ea3 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b/users/9a7eb1a4cbf94ca1885206a3e0b55754/roles/cfb149781a404c6892fa0ff5b015482d` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:31.875606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66187683-2f80-4f72-af1f-2f75b2796ea3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d88de896b4844391a04f85a2cc39591b, user_id=9a7eb1a4cbf94ca1885206a3e0b55754, role_id=cfb149781a404c6892fa0ff5b015482d)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:31.877383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66187683-2f80-4f72-af1f-2f75b2796ea3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:31.879030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1d58b-88ed-4910-af16-a82052f61fec None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:31.907229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:31.964384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 145/289] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:32:31 2022] PUT /identity/v3/projects/d88de896b4844391a04f85a2cc39591b/users/9a7eb1a4cbf94ca1885206a3e0b55754/roles/cfb149781a404c6892fa0ff5b015482d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:31.998163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1d58b-88ed-4910-af16-a82052f61fec None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:32.039936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059094a-f858-471e-8665-9331b15f2d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:32.040641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059094a-f858-471e-8665-9331b15f2d7e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:32.040947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059094a-f858-471e-8665-9331b15f2d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:32.041215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059094a-f858-471e-8665-9331b15f2d7e None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:32.042023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059094a-f858-471e-8665-9331b15f2d7e None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:32.042390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059094a-f858-471e-8665-9331b15f2d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:32.043839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059094a-f858-471e-8665-9331b15f2d7e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:32.063010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 145/290] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:32.071068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66187683-2f80-4f72-af1f-2f75b2796ea3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:32.194608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66187683-2f80-4f72-af1f-2f75b2796ea3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:32.211088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:32.237044 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00664829-a5bb-452d-9174-2db207fd344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:32.237854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00664829-a5bb-452d-9174-2db207fd344b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:32.238173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00664829-a5bb-452d-9174-2db207fd344b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:32.238456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00664829-a5bb-452d-9174-2db207fd344b None admin] PATH_INFO: `/v3/users/b4f8db193d924987b1bfb460e1091ba2` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:32.239665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00664829-a5bb-452d-9174-2db207fd344b None admin] RBAC: Authorizing `identity:get_user(user_id=b4f8db193d924987b1bfb460e1091ba2)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:32.241182 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00664829-a5bb-452d-9174-2db207fd344b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:32.243440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 146/291] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:32 2022] GET /identity/v3/users/b4f8db193d924987b1bfb460e1091ba2 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:32.249543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059094a-f858-471e-8665-9331b15f2d7e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:32.350423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:32.371990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059094a-f858-471e-8665-9331b15f2d7e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:32.417477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f4797-af22-469d-9cf2-c412446aa1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:32.418199 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f4797-af22-469d-9cf2-c412446aa1bd None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:32.418493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f4797-af22-469d-9cf2-c412446aa1bd None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:32.418778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f4797-af22-469d-9cf2-c412446aa1bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:32.512207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f4797-af22-469d-9cf2-c412446aa1bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:32.513640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f4797-af22-469d-9cf2-c412446aa1bd None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:32.608908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:32.637503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 146/292] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:32.639126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00664829-a5bb-452d-9174-2db207fd344b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:32.836942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00664829-a5bb-452d-9174-2db207fd344b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:32.883607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8855fba-7f5f-43d0-aa70-e2d6ab1f54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:32.884482 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8855fba-7f5f-43d0-aa70-e2d6ab1f54ca None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:32.884755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8855fba-7f5f-43d0-aa70-e2d6ab1f54ca None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:32.885033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8855fba-7f5f-43d0-aa70-e2d6ab1f54ca None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:32.886251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8855fba-7f5f-43d0-aa70-e2d6ab1f54ca None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:32.887707 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8855fba-7f5f-43d0-aa70-e2d6ab1f54ca None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:32.895096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 147/293] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:32 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:32.900863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f4797-af22-469d-9cf2-c412446aa1bd None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:33.062142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f4797-af22-469d-9cf2-c412446aa1bd None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:33.120539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee0738-3246-4420-a01d-d053cc58c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:33.121134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee0738-3246-4420-a01d-d053cc58c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:33.121423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee0738-3246-4420-a01d-d053cc58c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:33.121712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee0738-3246-4420-a01d-d053cc58c7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:33.123122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee0738-3246-4420-a01d-d053cc58c7f9 None admin] RBAC: Adding query filter params (role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=d88de896b4844391a04f85a2cc39591b, user.id=b4f8db193d924987b1bfb460e1091ba2) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:33.123439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee0738-3246-4420-a01d-d053cc58c7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:33.124882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee0738-3246-4420-a01d-d053cc58c7f9 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:33.134550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 147/294] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:32 2022] GET /identity/v3/role_assignments?user.id=b4f8db193d924987b1bfb460e1091ba2&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:33.295231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1caa-dbe7-4561-bfb6-6747abbbdd83 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:33.295747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1caa-dbe7-4561-bfb6-6747abbbdd83 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:33.295819 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1caa-dbe7-4561-bfb6-6747abbbdd83 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:33.297444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 148/295] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:33.302810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d3d3b-38db-4edd-ab33-642a821ddb21 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:33.303102 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d3d3b-38db-4edd-ab33-642a821ddb21 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:33.303378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d3d3b-38db-4edd-ab33-642a821ddb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:33.331067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3c6d3d3b-38db-4edd-ab33-642a821ddb21 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:33.332314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3c6d3d3b-38db-4edd-ab33-642a821ddb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:33.386344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:33.414368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 148/296] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:33.442727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1caa-dbe7-4561-bfb6-6747abbbdd83 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:33.502434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:33.523213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87431ee6-bc3a-4351-9be6-bd9fafb543ae None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:33.523511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87431ee6-bc3a-4351-9be6-bd9fafb543ae None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:33.523792 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87431ee6-bc3a-4351-9be6-bd9fafb543ae None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:33.525366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 149/297] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:33.533968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c60fe-ffe8-473b-87be-0cd243615475 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:33.533968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c60fe-ffe8-473b-87be-0cd243615475 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:33.533968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c60fe-ffe8-473b-87be-0cd243615475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:33.554295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-240c60fe-ffe8-473b-87be-0cd243615475 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:33.556079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-240c60fe-ffe8-473b-87be-0cd243615475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:33.572442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1caa-dbe7-4561-bfb6-6747abbbdd83 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:33.619599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78689f2-306e-4418-9733-a5ada32c7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:33.620304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78689f2-306e-4418-9733-a5ada32c7f16 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:33.620590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78689f2-306e-4418-9733-a5ada32c7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:33.620867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78689f2-306e-4418-9733-a5ada32c7f16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:33.622863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78689f2-306e-4418-9733-a5ada32c7f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:33.625863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78689f2-306e-4418-9733-a5ada32c7f16 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:33.627904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 149/298] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:33.633307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78689f2-306e-4418-9733-a5ada32c7f16 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:33.654023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 150/299] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:33.680810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c60fe-ffe8-473b-87be-0cd243615475 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:33.756947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78689f2-306e-4418-9733-a5ada32c7f16 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:33.772988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:33.785482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c60fe-ffe8-473b-87be-0cd243615475 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:33.794862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:33.796996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fa6b5-9717-405c-8d9d-60b3a2cceb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:33.797890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fa6b5-9717-405c-8d9d-60b3a2cceb9e None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:33.798396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fa6b5-9717-405c-8d9d-60b3a2cceb9e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:33.798914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fa6b5-9717-405c-8d9d-60b3a2cceb9e None admin] PATH_INFO: `/v3/groups` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:33.799869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fa6b5-9717-405c-8d9d-60b3a2cceb9e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:33.807444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fa6b5-9717-405c-8d9d-60b3a2cceb9e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:33.825605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2befd-a201-40d4-ba79-98c091c1f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:33.826509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2befd-a201-40d4-ba79-98c091c1f853 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:33.826796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2befd-a201-40d4-ba79-98c091c1f853 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:33.827074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2befd-a201-40d4-ba79-98c091c1f853 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:33.837409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2befd-a201-40d4-ba79-98c091c1f853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-54e2befd-a201-40d4-ba79-98c091c1f853 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:33.845398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:33.846488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:33.847306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:33.852653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 151/300] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:33.856106 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2befd-a201-40d4-ba79-98c091c1f853 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:33.882556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 150/301] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Jun 30 10:32:33 2022] POST /identity/v3/groups => generated 229 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:32:33.969483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2befd-a201-40d4-ba79-98c091c1f853 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:34.007098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb9c43-8108-4003-a62b-2cdce1a31023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:34.008035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb9c43-8108-4003-a62b-2cdce1a31023 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.008330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb9c43-8108-4003-a62b-2cdce1a31023 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.008616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb9c43-8108-4003-a62b-2cdce1a31023 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.009395 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb9c43-8108-4003-a62b-2cdce1a31023 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:34.009709 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb9c43-8108-4003-a62b-2cdce1a31023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:34.011164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb9c43-8108-4003-a62b-2cdce1a31023 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:34.020959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 152/302] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:34.027711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fa6b5-9717-405c-8d9d-60b3a2cceb9e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:34.138553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fa6b5-9717-405c-8d9d-60b3a2cceb9e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:34.174427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef18c7-df27-46b8-a476-1c615e53bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:34.175316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef18c7-df27-46b8-a476-1c615e53bf8b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.175605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef18c7-df27-46b8-a476-1c615e53bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.175892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef18c7-df27-46b8-a476-1c615e53bf8b None admin] PATH_INFO: `/v3/users/6ae96b6069b746f8b26069ce8164c9fa` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.190346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef18c7-df27-46b8-a476-1c615e53bf8b None admin] RBAC: Authorizing `identity:get_user(user_id=6ae96b6069b746f8b26069ce8164c9fa)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:34.191841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef18c7-df27-46b8-a476-1c615e53bf8b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:34.193623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 151/303] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:34 2022] GET /identity/v3/users/6ae96b6069b746f8b26069ce8164c9fa => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:34.199446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb9c43-8108-4003-a62b-2cdce1a31023 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:34.226336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb1dc-2e24-4845-af58-ebd32ccfe248 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.226610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb1dc-2e24-4845-af58-ebd32ccfe248 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.226841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb1dc-2e24-4845-af58-ebd32ccfe248 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.228968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 152/304] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:34.230627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:34.234522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4c577-361b-45a9-a946-c093ec5d41cc None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.234817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4c577-361b-45a9-a946-c093ec5d41cc None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.235104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4c577-361b-45a9-a946-c093ec5d41cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.253206 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-77d4c577-361b-45a9-a946-c093ec5d41cc None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:34.255088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-77d4c577-361b-45a9-a946-c093ec5d41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:34.288554 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:34.315376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb9c43-8108-4003-a62b-2cdce1a31023 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:34.342099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 153/305] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:34.362405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f9219-7495-4809-b268-1fb63da5b3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:34.363079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f9219-7495-4809-b268-1fb63da5b3df None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.363519 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f9219-7495-4809-b268-1fb63da5b3df None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.363941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f9219-7495-4809-b268-1fb63da5b3df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.364875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f9219-7495-4809-b268-1fb63da5b3df None admin] RBAC: Adding query filter params (role.id=cfb149781a404c6892fa0ff5b015482d, user.id=6ae96b6069b746f8b26069ce8164c9fa, scope.system=all) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:34.365219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f9219-7495-4809-b268-1fb63da5b3df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:34.366088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4c577-361b-45a9-a946-c093ec5d41cc None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:34.367019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f9219-7495-4809-b268-1fb63da5b3df None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:34.379131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 153/306] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 30 10:32:34 2022] GET /identity/v3/role_assignments?user.id=6ae96b6069b746f8b26069ce8164c9fa&scope.system=all&role.id=cfb149781a404c6892fa0ff5b015482d => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:34.484074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4c577-361b-45a9-a946-c093ec5d41cc None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:34.522747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e168b1-4dce-4ebb-8d5a-3a6224cbcfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:34.523559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e168b1-4dce-4ebb-8d5a-3a6224cbcfa7 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.523846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e168b1-4dce-4ebb-8d5a-3a6224cbcfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.524130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e168b1-4dce-4ebb-8d5a-3a6224cbcfa7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.536866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e168b1-4dce-4ebb-8d5a-3a6224cbcfa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-83e168b1-4dce-4ebb-8d5a-3a6224cbcfa7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:34.544872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:34.545743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:34.546563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 154/307] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:34.551959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f9219-7495-4809-b268-1fb63da5b3df None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:34.649377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b47e87-82a5-45de-9dbf-1955bdc53d8b None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.649697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b47e87-82a5-45de-9dbf-1955bdc53d8b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.649959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b47e87-82a5-45de-9dbf-1955bdc53d8b None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.651415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 155/308] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:34.656065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:34.656371 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62749364-1e69-404a-aeb7-dd6a8d0e6e31 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.656665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62749364-1e69-404a-aeb7-dd6a8d0e6e31 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.656967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62749364-1e69-404a-aeb7-dd6a8d0e6e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.665852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f9219-7495-4809-b268-1fb63da5b3df None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:34.677427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-62749364-1e69-404a-aeb7-dd6a8d0e6e31 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:34.679083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-62749364-1e69-404a-aeb7-dd6a8d0e6e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:34.704186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:34.706810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123997-bdde-4633-8db4-9ba7f8c23670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:34.707499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123997-bdde-4633-8db4-9ba7f8c23670 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.707792 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123997-bdde-4633-8db4-9ba7f8c23670 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.708076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123997-bdde-4633-8db4-9ba7f8c23670 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.708843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123997-bdde-4633-8db4-9ba7f8c23670 None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:34.709158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123997-bdde-4633-8db4-9ba7f8c23670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:34.710574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123997-bdde-4633-8db4-9ba7f8c23670 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:34.719941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 154/309] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:34.725340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123997-bdde-4633-8db4-9ba7f8c23670 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:34.782137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 156/310] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:34.805322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62749364-1e69-404a-aeb7-dd6a8d0e6e31 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:34.860463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123997-bdde-4633-8db4-9ba7f8c23670 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:34.913432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb5a6-fef3-47e8-b783-7cbbd39cbd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:34.914862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb5a6-fef3-47e8-b783-7cbbd39cbd89 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.915749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb5a6-fef3-47e8-b783-7cbbd39cbd89 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.916484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb5a6-fef3-47e8-b783-7cbbd39cbd89 None admin] PATH_INFO: `/v3/users/92445179f79241fdb9be4e343e53e777` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.918167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fb5a6-fef3-47e8-b783-7cbbd39cbd89 None admin] RBAC: Authorizing `identity:get_user(user_id=92445179f79241fdb9be4e343e53e777)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:34.920465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fb5a6-fef3-47e8-b783-7cbbd39cbd89 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:34.921225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62749364-1e69-404a-aeb7-dd6a8d0e6e31 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:34.922816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 155/311] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:34 2022] GET /identity/v3/users/92445179f79241fdb9be4e343e53e777 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:34.930917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb5a6-fef3-47e8-b783-7cbbd39cbd89 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:34.957510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:34.971923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cac54-b008-486c-8e2e-4345a37f968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:34.973386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cac54-b008-486c-8e2e-4345a37f968d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:34.973893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cac54-b008-486c-8e2e-4345a37f968d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:34.974406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cac54-b008-486c-8e2e-4345a37f968d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:34.990163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cac54-b008-486c-8e2e-4345a37f968d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-292cac54-b008-486c-8e2e-4345a37f968d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:35.000268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:35.001171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:35.002008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 157/312] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:35.008847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cac54-b008-486c-8e2e-4345a37f968d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:35.025169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:35.047601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb5a6-fef3-47e8-b783-7cbbd39cbd89 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:35.082879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d35c70-4f01-48a6-9466-821e67223115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:35.084086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d35c70-4f01-48a6-9466-821e67223115 None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:35.084592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d35c70-4f01-48a6-9466-821e67223115 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:35.085063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d35c70-4f01-48a6-9466-821e67223115 None admin] PATH_INFO: `/v3/system/users/92445179f79241fdb9be4e343e53e777/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:35.086779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d35c70-4f01-48a6-9466-821e67223115 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=92445179f79241fdb9be4e343e53e777, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:35.088360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d35c70-4f01-48a6-9466-821e67223115 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:35.119258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cac54-b008-486c-8e2e-4345a37f968d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:35.157641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e626-ba58-4add-ad0d-342424ef7334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:35.158343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e626-ba58-4add-ad0d-342424ef7334 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:35.158634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e626-ba58-4add-ad0d-342424ef7334 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:35.158916 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e626-ba58-4add-ad0d-342424ef7334 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:35.159670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e626-ba58-4add-ad0d-342424ef7334 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:35.160036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e626-ba58-4add-ad0d-342424ef7334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:35.161491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e626-ba58-4add-ad0d-342424ef7334 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:35.170965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 156/313] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Jun 30 10:32:34 2022] PUT /identity/v3/system/users/92445179f79241fdb9be4e343e53e777/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:35.178407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 158/314] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:35.184427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d35c70-4f01-48a6-9466-821e67223115 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:35.284043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:35.304583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d35c70-4f01-48a6-9466-821e67223115 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:35.354182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7172f1-e039-438c-9b1a-65c1fd7393ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:35.355075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7172f1-e039-438c-9b1a-65c1fd7393ee None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:35.355361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7172f1-e039-438c-9b1a-65c1fd7393ee None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:35.355640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7172f1-e039-438c-9b1a-65c1fd7393ee None admin] PATH_INFO: `/v3/users/9a7eb1a4cbf94ca1885206a3e0b55754` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:35.357387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7172f1-e039-438c-9b1a-65c1fd7393ee None admin] RBAC: Authorizing `identity:get_user(user_id=9a7eb1a4cbf94ca1885206a3e0b55754)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:35.359083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7172f1-e039-438c-9b1a-65c1fd7393ee None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:35.361037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 157/315] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:35 2022] GET /identity/v3/users/9a7eb1a4cbf94ca1885206a3e0b55754 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:35.366606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e626-ba58-4add-ad0d-342424ef7334 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:35.447317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:35.477490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e626-ba58-4add-ad0d-342424ef7334 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:35.514530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237961-6a83-4cf3-acd6-d32ec09758a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:35.515195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237961-6a83-4cf3-acd6-d32ec09758a0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:35.515480 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237961-6a83-4cf3-acd6-d32ec09758a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:35.515754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237961-6a83-4cf3-acd6-d32ec09758a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:35.586151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237961-6a83-4cf3-acd6-d32ec09758a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:35.587659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237961-6a83-4cf3-acd6-d32ec09758a0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:35.664113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:35.690226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 159/316] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:35.695439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7172f1-e039-438c-9b1a-65c1fd7393ee None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:35.799278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7172f1-e039-438c-9b1a-65c1fd7393ee None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:35.833359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974300f7-ef15-4075-95d6-389e856c099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:35.834271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974300f7-ef15-4075-95d6-389e856c099e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:35.834557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974300f7-ef15-4075-95d6-389e856c099e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:35.834837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974300f7-ef15-4075-95d6-389e856c099e None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:35.836026 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974300f7-ef15-4075-95d6-389e856c099e None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:35.837533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974300f7-ef15-4075-95d6-389e856c099e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:35.839500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 158/317] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:35 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:35.845731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237961-6a83-4cf3-acd6-d32ec09758a0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:35.946209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237961-6a83-4cf3-acd6-d32ec09758a0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:35.982361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dcfe9-d851-4054-987c-20d388919a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:35.983019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dcfe9-d851-4054-987c-20d388919a6c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:35.983299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dcfe9-d851-4054-987c-20d388919a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:35.983573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dcfe9-d851-4054-987c-20d388919a6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:35.984409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dcfe9-d851-4054-987c-20d388919a6c None admin] RBAC: Adding query filter params (role.id=cfb149781a404c6892fa0ff5b015482d, scope.project.id=d88de896b4844391a04f85a2cc39591b, user.id=9a7eb1a4cbf94ca1885206a3e0b55754) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:35.984728 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dcfe9-d851-4054-987c-20d388919a6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:35.986190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dcfe9-d851-4054-987c-20d388919a6c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:35.992718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 160/318] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:32:35 2022] GET /identity/v3/role_assignments?user.id=9a7eb1a4cbf94ca1885206a3e0b55754&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=cfb149781a404c6892fa0ff5b015482d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:36.123707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e596d8-155d-4957-89c7-691a338b421c None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.123903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e596d8-155d-4957-89c7-691a338b421c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.124186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e596d8-155d-4957-89c7-691a338b421c None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.125898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 159/319] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:36.130977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53fcc-4abd-476f-b51b-66e840f53cee None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.131273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53fcc-4abd-476f-b51b-66e840f53cee None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.131556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53fcc-4abd-476f-b51b-66e840f53cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.149905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a9a53fcc-4abd-476f-b51b-66e840f53cee None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:36.151241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a9a53fcc-4abd-476f-b51b-66e840f53cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:36.182687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:36.222242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 161/320] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:36.245593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e596d8-155d-4957-89c7-691a338b421c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:36.271187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:36.351607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e596d8-155d-4957-89c7-691a338b421c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:36.386988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bae21-5afa-49ea-b3bd-82ad201c2a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:36.388323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bae21-5afa-49ea-b3bd-82ad201c2a51 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.388611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bae21-5afa-49ea-b3bd-82ad201c2a51 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.388886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bae21-5afa-49ea-b3bd-82ad201c2a51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.390077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bae21-5afa-49ea-b3bd-82ad201c2a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:36.391586 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bae21-5afa-49ea-b3bd-82ad201c2a51 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:36.394862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 160/321] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:36.399327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a53fcc-4abd-476f-b51b-66e840f53cee None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:36.485700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d157ae-a2b1-4f7c-9561-986b9cc76d72 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.486056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d157ae-a2b1-4f7c-9561-986b9cc76d72 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.486298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d157ae-a2b1-4f7c-9561-986b9cc76d72 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.487801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 161/322] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:36.492510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c75f-e63c-4c69-83cc-ab73dc4a8a62 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.492798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c75f-e63c-4c69-83cc-ab73dc4a8a62 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.493080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c75f-e63c-4c69-83cc-ab73dc4a8a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.507190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a53fcc-4abd-476f-b51b-66e840f53cee None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:36.510865 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-8635c75f-e63c-4c69-83cc-ab73dc4a8a62 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:36.512049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8635c75f-e63c-4c69-83cc-ab73dc4a8a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:36.548765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb72b-0c43-486c-838a-210cc53d19ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:36.549429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb72b-0c43-486c-838a-210cc53d19ea None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.549716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb72b-0c43-486c-838a-210cc53d19ea None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.550020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb72b-0c43-486c-838a-210cc53d19ea None admin] PATH_INFO: `/v3/groups` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.550707 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb72b-0c43-486c-838a-210cc53d19ea None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:36.552393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb72b-0c43-486c-838a-210cc53d19ea None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:36.578868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 162/323] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:36.601313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c75f-e63c-4c69-83cc-ab73dc4a8a62 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:36.621557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:36.659673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 162/324] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Jun 30 10:32:36 2022] POST /identity/v3/groups => generated 226 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:36.705369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c75f-e63c-4c69-83cc-ab73dc4a8a62 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:36.752285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339201de-1924-4812-abe3-ceeac4fbe70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:36.753506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339201de-1924-4812-abe3-ceeac4fbe70b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.753973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339201de-1924-4812-abe3-ceeac4fbe70b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.754398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339201de-1924-4812-abe3-ceeac4fbe70b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.768331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339201de-1924-4812-abe3-ceeac4fbe70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-339201de-1924-4812-abe3-ceeac4fbe70b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:36.777374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:36.778340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:36.779130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 163/325] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:36.786076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb72b-0c43-486c-838a-210cc53d19ea None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:36.819003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:36.903960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb72b-0c43-486c-838a-210cc53d19ea None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:36.940465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2712802-a2eb-4dfe-a945-10d829879666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:36.941073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2712802-a2eb-4dfe-a945-10d829879666 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.941362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2712802-a2eb-4dfe-a945-10d829879666 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.941651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2712802-a2eb-4dfe-a945-10d829879666 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.942450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2712802-a2eb-4dfe-a945-10d829879666 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:36.942764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2712802-a2eb-4dfe-a945-10d829879666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:36.944234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2712802-a2eb-4dfe-a945-10d829879666 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:36.953140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 163/326] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:36.958513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339201de-1924-4812-abe3-ceeac4fbe70b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:37.049119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:37.068893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339201de-1924-4812-abe3-ceeac4fbe70b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:37.105329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55280a-a9ca-406b-b37a-a6655e5b95aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:37.106247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55280a-a9ca-406b-b37a-a6655e5b95aa None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:37.107119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55280a-a9ca-406b-b37a-a6655e5b95aa None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:37.107406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55280a-a9ca-406b-b37a-a6655e5b95aa None admin] PATH_INFO: `/v3/users/6ae96b6069b746f8b26069ce8164c9fa` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:37.108648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55280a-a9ca-406b-b37a-a6655e5b95aa None admin] RBAC: Authorizing `identity:get_user(user_id=6ae96b6069b746f8b26069ce8164c9fa)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:37.110148 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55280a-a9ca-406b-b37a-a6655e5b95aa None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:37.112159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 164/327] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:36 2022] GET /identity/v3/users/6ae96b6069b746f8b26069ce8164c9fa => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:37.117578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2712802-a2eb-4dfe-a945-10d829879666 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:37.215436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:37.226407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2712802-a2eb-4dfe-a945-10d829879666 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:37.264265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fbc2f-7807-4c64-9152-a7fe986f47e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:37.265141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fbc2f-7807-4c64-9152-a7fe986f47e9 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:37.265425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fbc2f-7807-4c64-9152-a7fe986f47e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:37.265706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fbc2f-7807-4c64-9152-a7fe986f47e9 None admin] PATH_INFO: `/v3/system/users/6ae96b6069b746f8b26069ce8164c9fa/roles/cfb149781a404c6892fa0ff5b015482d` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:37.267242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fbc2f-7807-4c64-9152-a7fe986f47e9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6ae96b6069b746f8b26069ce8164c9fa, role_id=cfb149781a404c6892fa0ff5b015482d)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:37.268624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fbc2f-7807-4c64-9152-a7fe986f47e9 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:37.292238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b2bf-0902-4c7b-aa36-949637c529a9 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:37.292550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b2bf-0902-4c7b-aa36-949637c529a9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:37.292809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b2bf-0902-4c7b-aa36-949637c529a9 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:37.294607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 165/328] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:37.299842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415de696-a68c-4b7e-9271-c8c86c09de7a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:37.300133 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415de696-a68c-4b7e-9271-c8c86c09de7a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:37.300414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415de696-a68c-4b7e-9271-c8c86c09de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:37.319355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-415de696-a68c-4b7e-9271-c8c86c09de7a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:37.320587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-415de696-a68c-4b7e-9271-c8c86c09de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:37.357596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 164/329] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Jun 30 10:32:37 2022] PUT /identity/v3/system/users/6ae96b6069b746f8b26069ce8164c9fa/roles/cfb149781a404c6892fa0ff5b015482d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:37.406527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 166/330] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:37.431094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fbc2f-7807-4c64-9152-a7fe986f47e9 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:37.568663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fbc2f-7807-4c64-9152-a7fe986f47e9 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:37.611863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeca63-0f23-4499-88eb-eb3e44967bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:37.613100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeca63-0f23-4499-88eb-eb3e44967bb2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:37.613582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeca63-0f23-4499-88eb-eb3e44967bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:37.614077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeca63-0f23-4499-88eb-eb3e44967bb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:37.631258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aeca63-0f23-4499-88eb-eb3e44967bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-57aeca63-0f23-4499-88eb-eb3e44967bb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:37.640155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:37.645611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:37.646441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:37.647848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 165/331] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:37.648066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415de696-a68c-4b7e-9271-c8c86c09de7a None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:37.765107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:37.795239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415de696-a68c-4b7e-9271-c8c86c09de7a None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:37.835225 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56d534-baa7-4410-8106-fb3a5f7d3c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:37.836708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56d534-baa7-4410-8106-fb3a5f7d3c5e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:37.837189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56d534-baa7-4410-8106-fb3a5f7d3c5e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:37.837656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56d534-baa7-4410-8106-fb3a5f7d3c5e None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:37.838665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56d534-baa7-4410-8106-fb3a5f7d3c5e None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:37.839168 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56d534-baa7-4410-8106-fb3a5f7d3c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:37.840770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56d534-baa7-4410-8106-fb3a5f7d3c5e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:37.851762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 167/332] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:37.855816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeca63-0f23-4499-88eb-eb3e44967bb2 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:37.885296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:38.026388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeca63-0f23-4499-88eb-eb3e44967bb2 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:38.069275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece4047-f8b2-4bc5-ab59-7519f1aa6444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:38.070195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece4047-f8b2-4bc5-ab59-7519f1aa6444 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:38.070488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece4047-f8b2-4bc5-ab59-7519f1aa6444 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:38.070774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece4047-f8b2-4bc5-ab59-7519f1aa6444 None admin] PATH_INFO: `/v3/users/92445179f79241fdb9be4e343e53e777` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:38.072004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece4047-f8b2-4bc5-ab59-7519f1aa6444 None admin] RBAC: Authorizing `identity:get_user(user_id=92445179f79241fdb9be4e343e53e777)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:38.073470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece4047-f8b2-4bc5-ab59-7519f1aa6444 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:38.075538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 166/333] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:37 2022] GET /identity/v3/users/92445179f79241fdb9be4e343e53e777 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:38.081276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56d534-baa7-4410-8106-fb3a5f7d3c5e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:38.203067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56d534-baa7-4410-8106-fb3a5f7d3c5e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:38.240541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da523c5-7c66-4754-ad48-8c5267e0d096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:38.241214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da523c5-7c66-4754-ad48-8c5267e0d096 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:38.241509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da523c5-7c66-4754-ad48-8c5267e0d096 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:38.241796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da523c5-7c66-4754-ad48-8c5267e0d096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:38.242682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da523c5-7c66-4754-ad48-8c5267e0d096 None admin] RBAC: Adding query filter params (role.id=217ceb9b91034918b3bb34c38120ab4f, user.id=92445179f79241fdb9be4e343e53e777, scope.system=all) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:38.243007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da523c5-7c66-4754-ad48-8c5267e0d096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:38.244481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da523c5-7c66-4754-ad48-8c5267e0d096 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:38.251164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:38.262058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 168/334] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 30 10:32:38 2022] GET /identity/v3/role_assignments?user.id=92445179f79241fdb9be4e343e53e777&scope.system=all&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:39.586500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0a631-73bc-465b-b276-7a62ce155420 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:39.587521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0a631-73bc-465b-b276-7a62ce155420 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:39.588016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0a631-73bc-465b-b276-7a62ce155420 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:39.589869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 167/335] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:39.595773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3ec1-b40b-4f3e-a752-9225125b29c3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:39.596607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3ec1-b40b-4f3e-a752-9225125b29c3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:39.597155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3ec1-b40b-4f3e-a752-9225125b29c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:39.618499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f89c3ec1-b40b-4f3e-a752-9225125b29c3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:39.620016 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f89c3ec1-b40b-4f3e-a752-9225125b29c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:39.711521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 169/336] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:39.727007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17182761-f869-4b5e-812a-ba9654932087 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:39.727601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17182761-f869-4b5e-812a-ba9654932087 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:39.728105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17182761-f869-4b5e-812a-ba9654932087 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:39.729689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 168/337] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:39.735665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343993-c9e1-41d1-90a1-37a9b0fc1e23 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:39.736209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343993-c9e1-41d1-90a1-37a9b0fc1e23 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:39.736698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343993-c9e1-41d1-90a1-37a9b0fc1e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:39.759681 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-84343993-c9e1-41d1-90a1-37a9b0fc1e23 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:39.761243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-84343993-c9e1-41d1-90a1-37a9b0fc1e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:39.765328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17182761-f869-4b5e-812a-ba9654932087 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:39.875439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 170/338] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:39.922101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:39.924659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343993-c9e1-41d1-90a1-37a9b0fc1e23 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:39.963681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17182761-f869-4b5e-812a-ba9654932087 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:40.020904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:40.022212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b9944-f4c0-42ef-ac80-11b14afc54f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:40.023367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b9944-f4c0-42ef-ac80-11b14afc54f2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.023856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b9944-f4c0-42ef-ac80-11b14afc54f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.024339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b9944-f4c0-42ef-ac80-11b14afc54f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.051019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b9944-f4c0-42ef-ac80-11b14afc54f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-068b9944-f4c0-42ef-ac80-11b14afc54f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:40.059519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:40.060370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:40.061152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:40.073015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 169/339] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:40.080048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f4f04-6d79-465f-ae34-a06d1a16a48f None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.082098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f4f04-6d79-465f-ae34-a06d1a16a48f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.082631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f4f04-6d79-465f-ae34-a06d1a16a48f None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.086015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 170/340] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:40.087008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f4f04-6d79-465f-ae34-a06d1a16a48f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:40.108130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343993-c9e1-41d1-90a1-37a9b0fc1e23 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:40.178741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea393b-c808-4bb6-8539-b7e221d033a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:40.181777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea393b-c808-4bb6-8539-b7e221d033a5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.182295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea393b-c808-4bb6-8539-b7e221d033a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.182946 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea393b-c808-4bb6-8539-b7e221d033a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.204281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea393b-c808-4bb6-8539-b7e221d033a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-26ea393b-c808-4bb6-8539-b7e221d033a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:40.212423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:40.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:40.214121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:40.223373 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 171/341] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:40.228437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6316a3-484f-4c0d-83b4-6b88f28e1be7 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.229965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6316a3-484f-4c0d-83b4-6b88f28e1be7 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.230456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6316a3-484f-4c0d-83b4-6b88f28e1be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.260058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-bd6316a3-484f-4c0d-83b4-6b88f28e1be7 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:40.262344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bd6316a3-484f-4c0d-83b4-6b88f28e1be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:40.293057 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f4f04-6d79-465f-ae34-a06d1a16a48f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:40.355048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3740c3a-6f83-4dee-8223-69449eb72b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:40.356127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3740c3a-6f83-4dee-8223-69449eb72b8a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.356612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3740c3a-6f83-4dee-8223-69449eb72b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.357103 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3740c3a-6f83-4dee-8223-69449eb72b8a None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.358156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3740c3a-6f83-4dee-8223-69449eb72b8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:40.358663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3740c3a-6f83-4dee-8223-69449eb72b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:40.360264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3740c3a-6f83-4dee-8223-69449eb72b8a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:40.374549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 171/342] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:40.375691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3740c3a-6f83-4dee-8223-69449eb72b8a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:40.403766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 172/343] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:40.404291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:40.404925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6316a3-484f-4c0d-83b4-6b88f28e1be7 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:40.502386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:40.573556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3740c3a-6f83-4dee-8223-69449eb72b8a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:40.609245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6316a3-484f-4c0d-83b4-6b88f28e1be7 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:40.648233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c5bc-90f5-42f8-9cdf-d076b38ea538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:40.648915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c5bc-90f5-42f8-9cdf-d076b38ea538 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.649203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c5bc-90f5-42f8-9cdf-d076b38ea538 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.649485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c5bc-90f5-42f8-9cdf-d076b38ea538 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.650280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9c5bc-90f5-42f8-9cdf-d076b38ea538 None admin] RBAC: Adding query filter params (name=member) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:40.650594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9c5bc-90f5-42f8-9cdf-d076b38ea538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:40.652004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9c5bc-90f5-42f8-9cdf-d076b38ea538 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:40.666366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02d11e-2e0b-4fea-b6ce-432e471d5d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:40.667053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d11e-2e0b-4fea-b6ce-432e471d5d27 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.667373 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d11e-2e0b-4fea-b6ce-432e471d5d27 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.667656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d11e-2e0b-4fea-b6ce-432e471d5d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.673696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 172/344] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:40.675556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c5bc-90f5-42f8-9cdf-d076b38ea538 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:40.758968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02d11e-2e0b-4fea-b6ce-432e471d5d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:40.760743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02d11e-2e0b-4fea-b6ce-432e471d5d27 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:40.771781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:40.810882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c5bc-90f5-42f8-9cdf-d076b38ea538 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:40.812307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:40.849781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0e8f4-2fac-4199-b4d2-7ac725471994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:40.851228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0e8f4-2fac-4199-b4d2-7ac725471994 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.851404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0e8f4-2fac-4199-b4d2-7ac725471994 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.851658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0e8f4-2fac-4199-b4d2-7ac725471994 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.865794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0e8f4-2fac-4199-b4d2-7ac725471994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-aaf0e8f4-2fac-4199-b4d2-7ac725471994 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:40.873682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:40.874594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:40.875407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 173/345] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:40.878762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0e8f4-2fac-4199-b4d2-7ac725471994 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:40.880676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 173/346] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:40.882171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fdd44-a388-4458-952d-a08e0978c110 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.882604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fdd44-a388-4458-952d-a08e0978c110 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.883060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fdd44-a388-4458-952d-a08e0978c110 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.884774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 174/347] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:40.886029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790182e-380e-4930-8f95-77ad417b90cc None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.886517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790182e-380e-4930-8f95-77ad417b90cc None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.886990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790182e-380e-4930-8f95-77ad417b90cc None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.888686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 175/348] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:40.889586 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790182e-380e-4930-8f95-77ad417b90cc None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:41.026490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0e8f4-2fac-4199-b4d2-7ac725471994 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:41.034569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790182e-380e-4930-8f95-77ad417b90cc None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:41.061173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:41.075700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3f8d3-a04b-4394-b7cb-4e332190c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:41.079569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3f8d3-a04b-4394-b7cb-4e332190c37a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.079569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3f8d3-a04b-4394-b7cb-4e332190c37a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.079569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3f8d3-a04b-4394-b7cb-4e332190c37a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.079781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4988-f427-46c6-91ca-c55c1a6374f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:41.079781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4988-f427-46c6-91ca-c55c1a6374f2 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.079781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4988-f427-46c6-91ca-c55c1a6374f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.079781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4988-f427-46c6-91ca-c55c1a6374f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.080365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec4988-f427-46c6-91ca-c55c1a6374f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:41.080681 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec4988-f427-46c6-91ca-c55c1a6374f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:41.082099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec4988-f427-46c6-91ca-c55c1a6374f2 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:41.094414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 176/349] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:41.095456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4988-f427-46c6-91ca-c55c1a6374f2 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:41.109522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:41.174873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3f8d3-a04b-4394-b7cb-4e332190c37a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:41.176602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3f8d3-a04b-4394-b7cb-4e332190c37a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:41.229620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4988-f427-46c6-91ca-c55c1a6374f2 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:41.279736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b4350-3952-4c91-a25c-1461a2dffe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:41.281268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b4350-3952-4c91-a25c-1461a2dffe9e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.282153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b4350-3952-4c91-a25c-1461a2dffe9e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.282578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b4350-3952-4c91-a25c-1461a2dffe9e None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.284223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b4350-3952-4c91-a25c-1461a2dffe9e None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:41.286703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b4350-3952-4c91-a25c-1461a2dffe9e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:41.289290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 177/350] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:41 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:41.290603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df88f3e-e878-4d3d-b246-31a43f036d3d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.291021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df88f3e-e878-4d3d-b246-31a43f036d3d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.291423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df88f3e-e878-4d3d-b246-31a43f036d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.307944 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 174/351] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:41.309577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d36e-a58b-4352-b02b-4f7d5a594e18 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.309871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d36e-a58b-4352-b02b-4f7d5a594e18 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.310178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d36e-a58b-4352-b02b-4f7d5a594e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.316945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9df88f3e-e878-4d3d-b246-31a43f036d3d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:41.317317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9df88f3e-e878-4d3d-b246-31a43f036d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:41.329462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-9626d36e-a58b-4352-b02b-4f7d5a594e18 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:41.330699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9626d36e-a58b-4352-b02b-4f7d5a594e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:41.359255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:41.409868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 175/352] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:41.411482 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d36e-a58b-4352-b02b-4f7d5a594e18 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:41.418314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 178/353] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:41.425957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df88f3e-e878-4d3d-b246-31a43f036d3d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:41.440714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:41.535114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d36e-a58b-4352-b02b-4f7d5a594e18 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:41.546492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df88f3e-e878-4d3d-b246-31a43f036d3d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:41.575868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05043dc-71cf-4f88-95e0-75c709010afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:41.577149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05043dc-71cf-4f88-95e0-75c709010afa None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.577416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05043dc-71cf-4f88-95e0-75c709010afa None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.577692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05043dc-71cf-4f88-95e0-75c709010afa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.587373 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e9359-3b3b-43bb-8f54-ca091ed6985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:41.588246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e9359-3b3b-43bb-8f54-ca091ed6985d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.588529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e9359-3b3b-43bb-8f54-ca091ed6985d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.588974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e9359-3b3b-43bb-8f54-ca091ed6985d None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.596457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e9359-3b3b-43bb-8f54-ca091ed6985d None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:41.597929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e9359-3b3b-43bb-8f54-ca091ed6985d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:41.600187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 179/354] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:41 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:41.600837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e9359-3b3b-43bb-8f54-ca091ed6985d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:41.610618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:41.671481 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05043dc-71cf-4f88-95e0-75c709010afa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:41.673004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05043dc-71cf-4f88-95e0-75c709010afa None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:41.681005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:41.714668 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e9359-3b3b-43bb-8f54-ca091ed6985d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:41.755753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad67d5-858b-42d2-8000-e25571f9a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:41.756623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad67d5-858b-42d2-8000-e25571f9a378 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.756912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad67d5-858b-42d2-8000-e25571f9a378 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.757192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad67d5-858b-42d2-8000-e25571f9a378 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.758596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad67d5-858b-42d2-8000-e25571f9a378 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:41.884611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad67d5-858b-42d2-8000-e25571f9a378 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:41.884611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 180/355] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:41 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:41.884611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad67d5-858b-42d2-8000-e25571f9a378 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:41.884897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 176/356] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:41.884897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05043dc-71cf-4f88-95e0-75c709010afa None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:41.884897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:41.896468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad67d5-858b-42d2-8000-e25571f9a378 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:41.925508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05043dc-71cf-4f88-95e0-75c709010afa None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:41.933855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87a639-f023-43d6-995c-d2fd6b47e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:41.935268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87a639-f023-43d6-995c-d2fd6b47e36f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.935555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87a639-f023-43d6-995c-d2fd6b47e36f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.936225 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87a639-f023-43d6-995c-d2fd6b47e36f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.944609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:41.948457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87a639-f023-43d6-995c-d2fd6b47e36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-bb87a639-f023-43d6-995c-d2fd6b47e36f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:41.956626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:41.957626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:41.958605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:41.962350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 181/357] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:41.963716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45f16-d8ca-495e-bb94-f6a7aa4d7aa7 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.964007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45f16-d8ca-495e-bb94-f6a7aa4d7aa7 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.964284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45f16-d8ca-495e-bb94-f6a7aa4d7aa7 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.965647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 182/358] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:41.967951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a45f16-d8ca-495e-bb94-f6a7aa4d7aa7 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:41.982464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f95e81-df77-4320-b667-492a7fd917b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:41.983846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95e81-df77-4320-b667-492a7fd917b9 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.985058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95e81-df77-4320-b667-492a7fd917b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.985058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95e81-df77-4320-b667-492a7fd917b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.998285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f95e81-df77-4320-b667-492a7fd917b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-30f95e81-df77-4320-b667-492a7fd917b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:42.006082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:42.007094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:32:42.008067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:42.012157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 177/359] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:42.013054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f95e81-df77-4320-b667-492a7fd917b9 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:42.092901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a45f16-d8ca-495e-bb94-f6a7aa4d7aa7 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:42.133810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f95e81-df77-4320-b667-492a7fd917b9 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:42.146276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a9669-4bed-41c8-839a-293d305fb651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:42.147194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a9669-4bed-41c8-839a-293d305fb651 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:42.147483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a9669-4bed-41c8-839a-293d305fb651 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:42.147783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a9669-4bed-41c8-839a-293d305fb651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:42.148868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a9669-4bed-41c8-839a-293d305fb651 None admin] RBAC: Adding query filter params (group.id=8750de98abfc4890b34b14e4e2a31622, role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:42.148983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a9669-4bed-41c8-839a-293d305fb651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:42.150482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a9669-4bed-41c8-839a-293d305fb651 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:42.155884 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:42.162223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 183/360] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:41 2022] GET /identity/v3/role_assignments?group.id=8750de98abfc4890b34b14e4e2a31622&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:42.162223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a9669-4bed-41c8-839a-293d305fb651 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:42.188510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528da08c-cef2-41b1-9770-40d3c05a4608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:42.190125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528da08c-cef2-41b1-9770-40d3c05a4608 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:42.190537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528da08c-cef2-41b1-9770-40d3c05a4608 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:42.191892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528da08c-cef2-41b1-9770-40d3c05a4608 None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:42.193997 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528da08c-cef2-41b1-9770-40d3c05a4608 None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:42.195716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528da08c-cef2-41b1-9770-40d3c05a4608 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:42.197757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 178/361] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:42 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:42.202231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528da08c-cef2-41b1-9770-40d3c05a4608 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:42.266580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:42.327091 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a9669-4bed-41c8-839a-293d305fb651 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:42.367158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528da08c-cef2-41b1-9770-40d3c05a4608 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:42.376914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37ae9-97e9-4d81-a242-551d07841512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:42.378144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37ae9-97e9-4d81-a242-551d07841512 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:42.378436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37ae9-97e9-4d81-a242-551d07841512 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:42.378717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37ae9-97e9-4d81-a242-551d07841512 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:42.379932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c37ae9-97e9-4d81-a242-551d07841512 None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:42.381464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c37ae9-97e9-4d81-a242-551d07841512 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:42.384145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 184/362] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:42 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:42.385382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a4b18-baf5-450f-b257-870a71177dd2 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:42.385675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a4b18-baf5-450f-b257-870a71177dd2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:42.386001 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a4b18-baf5-450f-b257-870a71177dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:42.407054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-369a4b18-baf5-450f-b257-870a71177dd2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:42.407651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6d88-1957-4077-8daf-94b3c5ea378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:42.408336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6d88-1957-4077-8daf-94b3c5ea378c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:42.408448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-369a4b18-baf5-450f-b257-870a71177dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:42.408660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6d88-1957-4077-8daf-94b3c5ea378c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:42.408909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6d88-1957-4077-8daf-94b3c5ea378c None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:42.409698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6d88-1957-4077-8daf-94b3c5ea378c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:42.410017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6d88-1957-4077-8daf-94b3c5ea378c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:42.411652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6d88-1957-4077-8daf-94b3c5ea378c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:42.424211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 179/363] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:42.426075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6d88-1957-4077-8daf-94b3c5ea378c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:42.483140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:42.492805 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 185/364] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:42.494604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a4b18-baf5-450f-b257-870a71177dd2 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:42.565848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6d88-1957-4077-8daf-94b3c5ea378c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:42.571051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:42.620195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638e1f-5de3-4629-bdb9-d293e5e6aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:42.621617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638e1f-5de3-4629-bdb9-d293e5e6aca2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:42.622173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638e1f-5de3-4629-bdb9-d293e5e6aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:42.622918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638e1f-5de3-4629-bdb9-d293e5e6aca2 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:42.624056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638e1f-5de3-4629-bdb9-d293e5e6aca2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:42.624559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638e1f-5de3-4629-bdb9-d293e5e6aca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:42.626496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638e1f-5de3-4629-bdb9-d293e5e6aca2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:42.627688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a4b18-baf5-450f-b257-870a71177dd2 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:42.639067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 180/365] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:42.640019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638e1f-5de3-4629-bdb9-d293e5e6aca2 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:42.668879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893156d2-244d-4a1f-b0c3-ef8641ead178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:42.669470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893156d2-244d-4a1f-b0c3-ef8641ead178 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:42.669758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893156d2-244d-4a1f-b0c3-ef8641ead178 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:42.670128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893156d2-244d-4a1f-b0c3-ef8641ead178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:42.670978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893156d2-244d-4a1f-b0c3-ef8641ead178 None admin] RBAC: Adding query filter params (group.id=8750de98abfc4890b34b14e4e2a31622, role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:42.671297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893156d2-244d-4a1f-b0c3-ef8641ead178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:42.672895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893156d2-244d-4a1f-b0c3-ef8641ead178 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:42.678780 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 186/366] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:42 2022] GET /identity/v3/role_assignments?group.id=8750de98abfc4890b34b14e4e2a31622&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:42.679572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893156d2-244d-4a1f-b0c3-ef8641ead178 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:42.784869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638e1f-5de3-4629-bdb9-d293e5e6aca2 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:42.800167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:42.806087 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893156d2-244d-4a1f-b0c3-ef8641ead178 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:42.837985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739d7e1-c034-43bd-bd55-d87c36a9ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:42.838956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d7e1-c034-43bd-bd55-d87c36a9ac55 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:42.839247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d7e1-c034-43bd-bd55-d87c36a9ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:42.839530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d7e1-c034-43bd-bd55-d87c36a9ac55 None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:42.841071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:42.844222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739d7e1-c034-43bd-bd55-d87c36a9ac55 None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:42.845958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739d7e1-c034-43bd-bd55-d87c36a9ac55 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:42.848087 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 181/367] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:42 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:42.849339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739d7e1-c034-43bd-bd55-d87c36a9ac55 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:42.853734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eabcf-24fc-444c-a84f-9d1e60606edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:42.855984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eabcf-24fc-444c-a84f-9d1e60606edc None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:42.855984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eabcf-24fc-444c-a84f-9d1e60606edc None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:42.855984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eabcf-24fc-444c-a84f-9d1e60606edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:42.930879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5eabcf-24fc-444c-a84f-9d1e60606edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:42.932669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5eabcf-24fc-444c-a84f-9d1e60606edc None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:42.975336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739d7e1-c034-43bd-bd55-d87c36a9ac55 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.011316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def00ddc-a263-4960-ab2f-6e396f268dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:43.013243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def00ddc-a263-4960-ab2f-6e396f268dd3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.014190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def00ddc-a263-4960-ab2f-6e396f268dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.014929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def00ddc-a263-4960-ab2f-6e396f268dd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.027910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def00ddc-a263-4960-ab2f-6e396f268dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-def00ddc-a263-4960-ab2f-6e396f268dd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:43.038866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:43.039747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:43.040538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:43.048674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 182/368] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:32:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:43.048674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def00ddc-a263-4960-ab2f-6e396f268dd3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.064949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 187/369] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:43.064949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eabcf-24fc-444c-a84f-9d1e60606edc None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.095449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:43.097978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:43.183028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def00ddc-a263-4960-ab2f-6e396f268dd3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.188660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eabcf-24fc-444c-a84f-9d1e60606edc None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.220848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1468624-8451-49e1-bbc2-4105718f8e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:43.222200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1468624-8451-49e1-bbc2-4105718f8e13 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.222630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1468624-8451-49e1-bbc2-4105718f8e13 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.223038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1468624-8451-49e1-bbc2-4105718f8e13 None admin] PATH_INFO: `/v3/users/6ae96b6069b746f8b26069ce8164c9fa` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.224814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1468624-8451-49e1-bbc2-4105718f8e13 None admin] RBAC: Authorizing `identity:get_user(user_id=6ae96b6069b746f8b26069ce8164c9fa)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:43.226462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1468624-8451-49e1-bbc2-4105718f8e13 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:43.228611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 183/370] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/users/6ae96b6069b746f8b26069ce8164c9fa => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:43.229565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1468624-8451-49e1-bbc2-4105718f8e13 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.244135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773de1-4bd3-4d69-9060-a9fceebf8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:43.244914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773de1-4bd3-4d69-9060-a9fceebf8554 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.245320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773de1-4bd3-4d69-9060-a9fceebf8554 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.245578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773de1-4bd3-4d69-9060-a9fceebf8554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.246548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79773de1-4bd3-4d69-9060-a9fceebf8554 None admin] RBAC: Adding query filter params (group.id=8750de98abfc4890b34b14e4e2a31622, role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=d88de896b4844391a04f85a2cc39591b) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:43.247501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79773de1-4bd3-4d69-9060-a9fceebf8554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:43.249072 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79773de1-4bd3-4d69-9060-a9fceebf8554 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:43.255517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 188/371] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/role_assignments?group.id=8750de98abfc4890b34b14e4e2a31622&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:43.256782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773de1-4bd3-4d69-9060-a9fceebf8554 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.345707 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1468624-8451-49e1-bbc2-4105718f8e13 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.348662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:43.358533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:43.368289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773de1-4bd3-4d69-9060-a9fceebf8554 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.385709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dbbe1-477f-4a2c-b231-9784cb18c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:43.386802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dbbe1-477f-4a2c-b231-9784cb18c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.387445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dbbe1-477f-4a2c-b231-9784cb18c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.387943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dbbe1-477f-4a2c-b231-9784cb18c9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.388965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dbbe1-477f-4a2c-b231-9784cb18c9a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:43.389496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dbbe1-477f-4a2c-b231-9784cb18c9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:43.391147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dbbe1-477f-4a2c-b231-9784cb18c9a3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:43.402388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 184/372] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:43.408753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dbbe1-477f-4a2c-b231-9784cb18c9a3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.409492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135c2b2-cb92-48d2-b393-67deea3ba5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:43.410429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135c2b2-cb92-48d2-b393-67deea3ba5b4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.410706 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135c2b2-cb92-48d2-b393-67deea3ba5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.410985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135c2b2-cb92-48d2-b393-67deea3ba5b4 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.412298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135c2b2-cb92-48d2-b393-67deea3ba5b4 None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:43.413877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135c2b2-cb92-48d2-b393-67deea3ba5b4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:43.415847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 189/373] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:43.416589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135c2b2-cb92-48d2-b393-67deea3ba5b4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.528425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135c2b2-cb92-48d2-b393-67deea3ba5b4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.530654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dbbe1-477f-4a2c-b231-9784cb18c9a3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.564944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355777b7-7bca-4753-922d-cabf7135d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:43.565586 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355777b7-7bca-4753-922d-cabf7135d281 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.565871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355777b7-7bca-4753-922d-cabf7135d281 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.566175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355777b7-7bca-4753-922d-cabf7135d281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.572764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b0640-ee3b-4123-890e-5b9334a7ab2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:43.573732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b0640-ee3b-4123-890e-5b9334a7ab2e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.574265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b0640-ee3b-4123-890e-5b9334a7ab2e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.574789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b0640-ee3b-4123-890e-5b9334a7ab2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.575853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b0640-ee3b-4123-890e-5b9334a7ab2e None admin] RBAC: Adding query filter params (role.id=cfb149781a404c6892fa0ff5b015482d, user.id=6ae96b6069b746f8b26069ce8164c9fa, scope.system=all) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:43.576374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b0640-ee3b-4123-890e-5b9334a7ab2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:43.578961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b0640-ee3b-4123-890e-5b9334a7ab2e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:43.594158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 185/374] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/role_assignments?user.id=6ae96b6069b746f8b26069ce8164c9fa&scope.system=all&role.id=cfb149781a404c6892fa0ff5b015482d => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:43.595293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b0640-ee3b-4123-890e-5b9334a7ab2e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.603147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:43.627138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:43.694857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355777b7-7bca-4753-922d-cabf7135d281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:43.700220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355777b7-7bca-4753-922d-cabf7135d281 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:43.763709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b0640-ee3b-4123-890e-5b9334a7ab2e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.812235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5064ca8-882e-4a9f-b627-fbd1ef03dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:43.813111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5064ca8-882e-4a9f-b627-fbd1ef03dba0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.813399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5064ca8-882e-4a9f-b627-fbd1ef03dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.813679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5064ca8-882e-4a9f-b627-fbd1ef03dba0 None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.814931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5064ca8-882e-4a9f-b627-fbd1ef03dba0 None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:43.816399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5064ca8-882e-4a9f-b627-fbd1ef03dba0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:43.818374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 186/375] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:43.824112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5064ca8-882e-4a9f-b627-fbd1ef03dba0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.861349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 190/376] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:43.866448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355777b7-7bca-4753-922d-cabf7135d281 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.931092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:43.972985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:43.976232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355777b7-7bca-4753-922d-cabf7135d281 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.990533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5064ca8-882e-4a9f-b627-fbd1ef03dba0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:44.013872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72615d7-1c10-4ba8-aa49-f2ba170637e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:44.015138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72615d7-1c10-4ba8-aa49-f2ba170637e2 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:44.015646 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72615d7-1c10-4ba8-aa49-f2ba170637e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:44.016123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72615d7-1c10-4ba8-aa49-f2ba170637e2 None admin] PATH_INFO: `/v3/projects/50d0b85329f04f0dbf62de05b9135235` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:44.017515 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72615d7-1c10-4ba8-aa49-f2ba170637e2 None admin] RBAC: Authorizing `identity:get_project(project_id=50d0b85329f04f0dbf62de05b9135235)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:44.019313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72615d7-1c10-4ba8-aa49-f2ba170637e2 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:44.021214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 191/377] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/projects/50d0b85329f04f0dbf62de05b9135235 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:44.027221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72615d7-1c10-4ba8-aa49-f2ba170637e2 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:44.058858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1e5c5-6ffd-42a3-9be8-06558323b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:44.059527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1e5c5-6ffd-42a3-9be8-06558323b9ed None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:44.059823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1e5c5-6ffd-42a3-9be8-06558323b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:44.060110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1e5c5-6ffd-42a3-9be8-06558323b9ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:44.060961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1e5c5-6ffd-42a3-9be8-06558323b9ed None admin] RBAC: Adding query filter params (group.id=8750de98abfc4890b34b14e4e2a31622, role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=d88de896b4844391a04f85a2cc39591b) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:44.061282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1e5c5-6ffd-42a3-9be8-06558323b9ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:44.062843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1e5c5-6ffd-42a3-9be8-06558323b9ed None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:44.076305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 187/378] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/role_assignments?group.id=8750de98abfc4890b34b14e4e2a31622&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:44.181989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72615d7-1c10-4ba8-aa49-f2ba170637e2 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:44.214567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:44.226205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943f6b2-b65b-4f6d-9762-4464f7d69ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:44.234920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943f6b2-b65b-4f6d-9762-4464f7d69ce5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:44.234920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943f6b2-b65b-4f6d-9762-4464f7d69ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:44.234920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943f6b2-b65b-4f6d-9762-4464f7d69ce5 None admin] PATH_INFO: `/v3/groups/a2da46fa9db5406caf3ecedc74d9a566` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:44.238781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943f6b2-b65b-4f6d-9762-4464f7d69ce5 None admin] RBAC: Authorizing `identity:get_group(group_id=a2da46fa9db5406caf3ecedc74d9a566)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:44.240290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943f6b2-b65b-4f6d-9762-4464f7d69ce5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:44.242219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 192/379] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:44 2022] GET /identity/v3/groups/a2da46fa9db5406caf3ecedc74d9a566 => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:44.248249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1e5c5-6ffd-42a3-9be8-06558323b9ed None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:44.384214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1e5c5-6ffd-42a3-9be8-06558323b9ed None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:44.428553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a958ce-846d-430a-90b1-14ec2c266290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:44.429564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a958ce-846d-430a-90b1-14ec2c266290 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:44.430069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a958ce-846d-430a-90b1-14ec2c266290 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:44.430571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a958ce-846d-430a-90b1-14ec2c266290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:44.431596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a958ce-846d-430a-90b1-14ec2c266290 None admin] RBAC: Adding query filter params (group.id=a2da46fa9db5406caf3ecedc74d9a566, role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=50d0b85329f04f0dbf62de05b9135235) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:44.432121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a958ce-846d-430a-90b1-14ec2c266290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:44.433746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a958ce-846d-430a-90b1-14ec2c266290 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:44.446768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 188/380] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:44 2022] GET /identity/v3/role_assignments?group.id=a2da46fa9db5406caf3ecedc74d9a566&scope.project.id=50d0b85329f04f0dbf62de05b9135235&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:44.834153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19f13d-2363-4c1d-9f3d-60a4a53488f5 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:44.834535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19f13d-2363-4c1d-9f3d-60a4a53488f5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:44.834727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19f13d-2363-4c1d-9f3d-60a4a53488f5 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:44.836408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 193/381] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:44.841508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98f69d-4333-4d9c-bf3a-b17ac6a11e40 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:44.841999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98f69d-4333-4d9c-bf3a-b17ac6a11e40 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:44.842078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98f69d-4333-4d9c-bf3a-b17ac6a11e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:44.867294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-dd98f69d-4333-4d9c-bf3a-b17ac6a11e40 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:44.868506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-dd98f69d-4333-4d9c-bf3a-b17ac6a11e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:44.887527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:44.970431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 189/382] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:45.005473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19f13d-2363-4c1d-9f3d-60a4a53488f5 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:45.052020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958504c1-ed09-48e9-b919-9703a78ba0cf None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:45.052357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958504c1-ed09-48e9-b919-9703a78ba0cf None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:45.052586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958504c1-ed09-48e9-b919-9703a78ba0cf None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:45.053982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 190/383] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:45.060066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4fef-556e-4bea-8ff6-17316ac9c3f2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:45.060765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4fef-556e-4bea-8ff6-17316ac9c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:45.061266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4fef-556e-4bea-8ff6-17316ac9c3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:45.080728 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-787e4fef-556e-4bea-8ff6-17316ac9c3f2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:45.082943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-787e4fef-556e-4bea-8ff6-17316ac9c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:45.169077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19f13d-2363-4c1d-9f3d-60a4a53488f5 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:45.200571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 191/384] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:45.213293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc1aad-6e6a-43f7-816b-9b668fd9bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:45.214377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc1aad-6e6a-43f7-816b-9b668fd9bf00 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:45.214879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc1aad-6e6a-43f7-816b-9b668fd9bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:45.215895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc1aad-6e6a-43f7-816b-9b668fd9bf00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:45.233264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc1aad-6e6a-43f7-816b-9b668fd9bf00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-becc1aad-6e6a-43f7-816b-9b668fd9bf00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:45.241826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:45.242772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:45.243594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:45.246537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 194/385] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:45.254356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4fef-556e-4bea-8ff6-17316ac9c3f2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:45.256825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc1aad-6e6a-43f7-816b-9b668fd9bf00 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:45.362303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:45.406338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:45.447534 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4fef-556e-4bea-8ff6-17316ac9c3f2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:45.452473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc1aad-6e6a-43f7-816b-9b668fd9bf00 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:45.499538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d657df9-63da-43d2-b06c-82bc7652bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:45.500224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d657df9-63da-43d2-b06c-82bc7652bb7f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:45.500519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d657df9-63da-43d2-b06c-82bc7652bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:45.500809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d657df9-63da-43d2-b06c-82bc7652bb7f None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:45.501570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d657df9-63da-43d2-b06c-82bc7652bb7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:45.501888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d657df9-63da-43d2-b06c-82bc7652bb7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:45.503358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d657df9-63da-43d2-b06c-82bc7652bb7f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:45.512966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 192/386] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:45.518683 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d657df9-63da-43d2-b06c-82bc7652bb7f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:45.522782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816eb77-9a1d-4fd7-b8f1-b28b908e231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:45.523640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816eb77-9a1d-4fd7-b8f1-b28b908e231b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:45.523929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816eb77-9a1d-4fd7-b8f1-b28b908e231b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:45.524207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816eb77-9a1d-4fd7-b8f1-b28b908e231b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:45.540875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816eb77-9a1d-4fd7-b8f1-b28b908e231b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-1816eb77-9a1d-4fd7-b8f1-b28b908e231b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:45.557525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:45.558484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:45.559910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:45.563044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 195/387] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:45.567743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816eb77-9a1d-4fd7-b8f1-b28b908e231b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:45.632214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d657df9-63da-43d2-b06c-82bc7652bb7f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:45.667720 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02599ee2-6298-4bc4-a165-66ec40f1ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:45.669492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02599ee2-6298-4bc4-a165-66ec40f1ccde None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:45.669925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02599ee2-6298-4bc4-a165-66ec40f1ccde None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:45.670238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02599ee2-6298-4bc4-a165-66ec40f1ccde None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:45.671457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02599ee2-6298-4bc4-a165-66ec40f1ccde None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:45.673318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02599ee2-6298-4bc4-a165-66ec40f1ccde None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:45.675488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 193/388] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:45 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:45.680968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02599ee2-6298-4bc4-a165-66ec40f1ccde None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:45.706391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:45.755185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816eb77-9a1d-4fd7-b8f1-b28b908e231b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:45.778158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:45.790205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02599ee2-6298-4bc4-a165-66ec40f1ccde None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:45.823673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e83d3d-61af-4abf-8983-473b8ea1d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:45.824567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e83d3d-61af-4abf-8983-473b8ea1d53e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:45.824921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e83d3d-61af-4abf-8983-473b8ea1d53e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:45.825271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e83d3d-61af-4abf-8983-473b8ea1d53e None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:45.826121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e83d3d-61af-4abf-8983-473b8ea1d53e None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:45.826490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e83d3d-61af-4abf-8983-473b8ea1d53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:45.828137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e83d3d-61af-4abf-8983-473b8ea1d53e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:45.828750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358ffc-510f-45a8-aa6e-2d60d4ef6bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:45.829915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358ffc-510f-45a8-aa6e-2d60d4ef6bcc None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:45.830435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358ffc-510f-45a8-aa6e-2d60d4ef6bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:45.830893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358ffc-510f-45a8-aa6e-2d60d4ef6bcc None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:45.832258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3358ffc-510f-45a8-aa6e-2d60d4ef6bcc None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:45.833932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3358ffc-510f-45a8-aa6e-2d60d4ef6bcc None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:45.836301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 194/389] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:45 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:45.842012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358ffc-510f-45a8-aa6e-2d60d4ef6bcc None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:45.851183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 196/390] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:45.857396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e83d3d-61af-4abf-8983-473b8ea1d53e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:45.942317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:45.993670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358ffc-510f-45a8-aa6e-2d60d4ef6bcc None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:46.048397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e83d3d-61af-4abf-8983-473b8ea1d53e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:46.067801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c8cc1-fb0e-44bd-a939-aee0b2b270aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:46.068800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c8cc1-fb0e-44bd-a939-aee0b2b270aa None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.069157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c8cc1-fb0e-44bd-a939-aee0b2b270aa None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.069526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c8cc1-fb0e-44bd-a939-aee0b2b270aa None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/groups/8750de98abfc4890b34b14e4e2a31622/roles/a49601657f8b4e909b0a9b2adb444573` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.072033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c8cc1-fb0e-44bd-a939-aee0b2b270aa None admin] RBAC: Authorizing `identity:create_grant(project_id=d0cdf4f8802048e4b1ba79f9cae3e998, group_id=8750de98abfc4890b34b14e4e2a31622, role_id=a49601657f8b4e909b0a9b2adb444573)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:46.073615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c8cc1-fb0e-44bd-a939-aee0b2b270aa None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:46.092014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061f25e-59bb-4073-8e18-e4c208cfb996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:46.096399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061f25e-59bb-4073-8e18-e4c208cfb996 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.096399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061f25e-59bb-4073-8e18-e4c208cfb996 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.096399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061f25e-59bb-4073-8e18-e4c208cfb996 None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.096399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061f25e-59bb-4073-8e18-e4c208cfb996 None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:46.096399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061f25e-59bb-4073-8e18-e4c208cfb996 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:46.102068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 197/391] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:45 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:46.102068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1c0a-49f4-48c2-bc4a-3f2850a47dfa None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.102068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1c0a-49f4-48c2-bc4a-3f2850a47dfa None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.102068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1c0a-49f4-48c2-bc4a-3f2850a47dfa None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.102068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 198/392] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:46.106593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec1c0a-49f4-48c2-bc4a-3f2850a47dfa None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:46.150679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 195/393] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 10:32:45 2022] PUT /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/groups/8750de98abfc4890b34b14e4e2a31622/roles/a49601657f8b4e909b0a9b2adb444573 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:46.152314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b5751-21a7-44f9-b3ec-0c58e3775729 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.153339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b5751-21a7-44f9-b3ec-0c58e3775729 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.153912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b5751-21a7-44f9-b3ec-0c58e3775729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.164012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:46.191270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-376b5751-21a7-44f9-b3ec-0c58e3775729 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:46.192547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-376b5751-21a7-44f9-b3ec-0c58e3775729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:46.302671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec1c0a-49f4-48c2-bc4a-3f2850a47dfa None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:46.311275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 196/394] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:46.339428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b5751-21a7-44f9-b3ec-0c58e3775729 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:46.370739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0aef2-d5b5-4c03-9989-1c8b2afd559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:46.371655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0aef2-d5b5-4c03-9989-1c8b2afd559b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.371939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0aef2-d5b5-4c03-9989-1c8b2afd559b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.372224 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0aef2-d5b5-4c03-9989-1c8b2afd559b None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.373662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0aef2-d5b5-4c03-9989-1c8b2afd559b None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:46.375076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0aef2-d5b5-4c03-9989-1c8b2afd559b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:46.377057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 199/395] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:46 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:46.382530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0aef2-d5b5-4c03-9989-1c8b2afd559b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:46.429410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:46.474529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b5751-21a7-44f9-b3ec-0c58e3775729 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:46.507893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0aef2-d5b5-4c03-9989-1c8b2afd559b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:46.520145 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4c814-5ba2-4f91-ae3d-4fe3139ee249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:46.520945 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4c814-5ba2-4f91-ae3d-4fe3139ee249 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.521230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4c814-5ba2-4f91-ae3d-4fe3139ee249 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.521506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4c814-5ba2-4f91-ae3d-4fe3139ee249 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.521792 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:46.533972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4c814-5ba2-4f91-ae3d-4fe3139ee249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-4ea4c814-5ba2-4f91-ae3d-4fe3139ee249 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:46.541906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:46.542809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:46.543638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:46.544317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 197/396] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:46.555175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4c814-5ba2-4f91-ae3d-4fe3139ee249 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:46.559993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b162-bfc8-4e06-b009-a38a5e7440e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:46.561218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b162-bfc8-4e06-b009-a38a5e7440e3 None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.561694 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b162-bfc8-4e06-b009-a38a5e7440e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.562516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b162-bfc8-4e06-b009-a38a5e7440e3 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/groups/8750de98abfc4890b34b14e4e2a31622/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.565775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2b162-bfc8-4e06-b009-a38a5e7440e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0cdf4f8802048e4b1ba79f9cae3e998, group_id=8750de98abfc4890b34b14e4e2a31622, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:46.567599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2b162-bfc8-4e06-b009-a38a5e7440e3 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:46.645620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 200/397] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 10:32:46 2022] PUT /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998/groups/8750de98abfc4890b34b14e4e2a31622/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:32:46.647566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd057d4-2fa2-4943-b91d-d55db3b04192 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.648024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd057d4-2fa2-4943-b91d-d55db3b04192 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.648512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd057d4-2fa2-4943-b91d-d55db3b04192 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.650147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 201/398] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:46.656004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07bf5-7684-42ea-9ca4-9b9aa553a6ac None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.656307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07bf5-7684-42ea-9ca4-9b9aa553a6ac None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.656588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07bf5-7684-42ea-9ca4-9b9aa553a6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.682691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4c814-5ba2-4f91-ae3d-4fe3139ee249 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:46.711381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-36f07bf5-7684-42ea-9ca4-9b9aa553a6ac None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:46.712416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-36f07bf5-7684-42ea-9ca4-9b9aa553a6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:46.720558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:46.730632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf896a06-6073-4b63-85f1-98e6ed961ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:46.731736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf896a06-6073-4b63-85f1-98e6ed961ed2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.732859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf896a06-6073-4b63-85f1-98e6ed961ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.733371 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf896a06-6073-4b63-85f1-98e6ed961ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.734379 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf896a06-6073-4b63-85f1-98e6ed961ed2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:46.734887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf896a06-6073-4b63-85f1-98e6ed961ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:46.736516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf896a06-6073-4b63-85f1-98e6ed961ed2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:46.748989 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 198/399] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:46.755446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf896a06-6073-4b63-85f1-98e6ed961ed2 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:46.875584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 202/400] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:46.885704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf896a06-6073-4b63-85f1-98e6ed961ed2 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:46.901968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07bf5-7684-42ea-9ca4-9b9aa553a6ac None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:46.926854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae51709-3fc5-4974-918a-028d00702d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:46.927718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae51709-3fc5-4974-918a-028d00702d43 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:46.928001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae51709-3fc5-4974-918a-028d00702d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:46.928276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae51709-3fc5-4974-918a-028d00702d43 None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:46.929471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae51709-3fc5-4974-918a-028d00702d43 None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:46.930956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae51709-3fc5-4974-918a-028d00702d43 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:46.932998 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 199/401] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:46 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:46.938752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae51709-3fc5-4974-918a-028d00702d43 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:47.003998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:47.008783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07bf5-7684-42ea-9ca4-9b9aa553a6ac None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:47.049312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e436b-ce70-4bdb-8b1e-03973a312133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:47.050845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e436b-ce70-4bdb-8b1e-03973a312133 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.051296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e436b-ce70-4bdb-8b1e-03973a312133 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.051720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e436b-ce70-4bdb-8b1e-03973a312133 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.076968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e436b-ce70-4bdb-8b1e-03973a312133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:47.078380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-600e436b-ce70-4bdb-8b1e-03973a312133 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:47.085275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:47.086207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:47.087031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:47.100012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 203/402] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:47.100934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e436b-ce70-4bdb-8b1e-03973a312133 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:47.127555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae51709-3fc5-4974-918a-028d00702d43 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:47.174402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c630cb4-d42d-4b00-a264-aa248b30e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:47.175996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c630cb4-d42d-4b00-a264-aa248b30e340 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.176480 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c630cb4-d42d-4b00-a264-aa248b30e340 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.176951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c630cb4-d42d-4b00-a264-aa248b30e340 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.178877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c630cb4-d42d-4b00-a264-aa248b30e340 None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:47.181103 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c630cb4-d42d-4b00-a264-aa248b30e340 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:47.185224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 200/403] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:46 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:47.187086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869257eb-b173-4cb9-8e4d-7138fd055d4e None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.187767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869257eb-b173-4cb9-8e4d-7138fd055d4e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.188638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869257eb-b173-4cb9-8e4d-7138fd055d4e None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.190626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 201/404] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:47.191528 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869257eb-b173-4cb9-8e4d-7138fd055d4e None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:47.240490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e436b-ce70-4bdb-8b1e-03973a312133 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:47.285739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f549bd-877e-43a7-b8ec-859cfa2b9df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:47.286549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f549bd-877e-43a7-b8ec-859cfa2b9df8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.286907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f549bd-877e-43a7-b8ec-859cfa2b9df8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.287246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f549bd-877e-43a7-b8ec-859cfa2b9df8 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.288060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f549bd-877e-43a7-b8ec-859cfa2b9df8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:47.288438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f549bd-877e-43a7-b8ec-859cfa2b9df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:47.289892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f549bd-877e-43a7-b8ec-859cfa2b9df8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:47.303507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 204/405] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:47.304999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592b8d-567a-44a6-9822-9cd47cc6214a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.305359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592b8d-567a-44a6-9822-9cd47cc6214a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.305708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592b8d-567a-44a6-9822-9cd47cc6214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.310467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869257eb-b173-4cb9-8e4d-7138fd055d4e None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:47.325115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-53592b8d-567a-44a6-9822-9cd47cc6214a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:47.327029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-53592b8d-567a-44a6-9822-9cd47cc6214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:47.344877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:47.346677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:47.350891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93984571-5262-4033-b477-5813bc5c17ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:47.356230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93984571-5262-4033-b477-5813bc5c17ab None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.356230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93984571-5262-4033-b477-5813bc5c17ab None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.356230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93984571-5262-4033-b477-5813bc5c17ab None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b/groups/8750de98abfc4890b34b14e4e2a31622/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.356230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93984571-5262-4033-b477-5813bc5c17ab None admin] RBAC: Authorizing `identity:create_grant(project_id=d88de896b4844391a04f85a2cc39591b, group_id=8750de98abfc4890b34b14e4e2a31622, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:47.356868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93984571-5262-4033-b477-5813bc5c17ab None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:47.400242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 205/406] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:47.403330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53592b8d-567a-44a6-9822-9cd47cc6214a None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:47.448013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 202/407] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 10:32:47 2022] PUT /identity/v3/projects/d88de896b4844391a04f85a2cc39591b/groups/8750de98abfc4890b34b14e4e2a31622/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:32:47.449078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93984571-5262-4033-b477-5813bc5c17ab None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:47.585413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93984571-5262-4033-b477-5813bc5c17ab None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:47.588193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53592b8d-567a-44a6-9822-9cd47cc6214a None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:47.631264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2738e70-de4b-4e78-8270-1224797da85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:47.632368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2738e70-de4b-4e78-8270-1224797da85a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.632666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2738e70-de4b-4e78-8270-1224797da85a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.632952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2738e70-de4b-4e78-8270-1224797da85a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.646601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2738e70-de4b-4e78-8270-1224797da85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-b2738e70-de4b-4e78-8270-1224797da85a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:47.661228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:47.662179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:47.662962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 203/408] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:32:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:47.664666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2738e70-de4b-4e78-8270-1224797da85a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:47.673912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f489365-17e9-4bdd-8f9e-e3af7024ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:47.675126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f489365-17e9-4bdd-8f9e-e3af7024ac79 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.675603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f489365-17e9-4bdd-8f9e-e3af7024ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.676094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f489365-17e9-4bdd-8f9e-e3af7024ac79 None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.677471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f489365-17e9-4bdd-8f9e-e3af7024ac79 None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:47.679143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f489365-17e9-4bdd-8f9e-e3af7024ac79 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:47.680956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 206/409] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:47 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:47.686504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f489365-17e9-4bdd-8f9e-e3af7024ac79 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:47.709404 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:47.723934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:47.797168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2738e70-de4b-4e78-8270-1224797da85a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:47.815258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f489365-17e9-4bdd-8f9e-e3af7024ac79 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:47.864790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075db8d5-512e-4f18-9abf-53d78728eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:47.865838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075db8d5-512e-4f18-9abf-53d78728eb55 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.866352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075db8d5-512e-4f18-9abf-53d78728eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.866838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075db8d5-512e-4f18-9abf-53d78728eb55 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.867954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075db8d5-512e-4f18-9abf-53d78728eb55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:47.869525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075db8d5-512e-4f18-9abf-53d78728eb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:47.872451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075db8d5-512e-4f18-9abf-53d78728eb55 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:47.883031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f42cd-f0f7-49c5-8933-00630b4c4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:47.884238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f42cd-f0f7-49c5-8933-00630b4c4b40 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:47.884715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f42cd-f0f7-49c5-8933-00630b4c4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:47.885180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f42cd-f0f7-49c5-8933-00630b4c4b40 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:47.886642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f42cd-f0f7-49c5-8933-00630b4c4b40 None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:47.890948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f42cd-f0f7-49c5-8933-00630b4c4b40 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:47.892868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 207/410] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:47 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:47.893739 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 204/411] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:47.898666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075db8d5-512e-4f18-9abf-53d78728eb55 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:47.905607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f42cd-f0f7-49c5-8933-00630b4c4b40 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:48.055112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075db8d5-512e-4f18-9abf-53d78728eb55 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:48.066399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:48.086316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:48.096276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5d202-ee89-4e9b-8060-184ad1c37f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:48.097166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5d202-ee89-4e9b-8060-184ad1c37f59 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:48.097448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5d202-ee89-4e9b-8060-184ad1c37f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:48.097723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5d202-ee89-4e9b-8060-184ad1c37f59 None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b/groups/8750de98abfc4890b34b14e4e2a31622/roles/a49601657f8b4e909b0a9b2adb444573` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:48.100992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f42cd-f0f7-49c5-8933-00630b4c4b40 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:48.104190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5d202-ee89-4e9b-8060-184ad1c37f59 None admin] RBAC: Authorizing `identity:create_grant(project_id=d88de896b4844391a04f85a2cc39591b, group_id=8750de98abfc4890b34b14e4e2a31622, role_id=a49601657f8b4e909b0a9b2adb444573)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:48.105684 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5d202-ee89-4e9b-8060-184ad1c37f59 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:48.142155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee922e0f-6766-4c11-b598-d35b2b17e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:48.143070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee922e0f-6766-4c11-b598-d35b2b17e326 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:48.143348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee922e0f-6766-4c11-b598-d35b2b17e326 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:48.143626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee922e0f-6766-4c11-b598-d35b2b17e326 None admin] PATH_INFO: `/v3/groups/a2da46fa9db5406caf3ecedc74d9a566` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:48.144836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee922e0f-6766-4c11-b598-d35b2b17e326 None admin] RBAC: Authorizing `identity:get_group(group_id=a2da46fa9db5406caf3ecedc74d9a566)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:48.146314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee922e0f-6766-4c11-b598-d35b2b17e326 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:48.147939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 208/412] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:47 2022] GET /identity/v3/groups/a2da46fa9db5406caf3ecedc74d9a566 => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:48.153558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee922e0f-6766-4c11-b598-d35b2b17e326 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:48.196215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 205/413] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 10:32:47 2022] PUT /identity/v3/projects/d88de896b4844391a04f85a2cc39591b/groups/8750de98abfc4890b34b14e4e2a31622/roles/a49601657f8b4e909b0a9b2adb444573 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:32:48.277205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee922e0f-6766-4c11-b598-d35b2b17e326 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:48.317491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2109c-15cd-41f1-8c03-2209d481bbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:48.318795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2109c-15cd-41f1-8c03-2209d481bbd9 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:48.319217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2109c-15cd-41f1-8c03-2209d481bbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:48.319645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2109c-15cd-41f1-8c03-2209d481bbd9 None admin] PATH_INFO: `/v3/projects/50d0b85329f04f0dbf62de05b9135235` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:48.321016 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2109c-15cd-41f1-8c03-2209d481bbd9 None admin] RBAC: Authorizing `identity:get_project(project_id=50d0b85329f04f0dbf62de05b9135235)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:48.322665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2109c-15cd-41f1-8c03-2209d481bbd9 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:48.325510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 209/414] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:48 2022] GET /identity/v3/projects/50d0b85329f04f0dbf62de05b9135235 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:48.331416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5d202-ee89-4e9b-8060-184ad1c37f59 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:48.459250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5d202-ee89-4e9b-8060-184ad1c37f59 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:48.499238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86792cb8-9608-4bac-9df5-dc6c77e36f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:48.500358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792cb8-9608-4bac-9df5-dc6c77e36f78 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:48.500782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792cb8-9608-4bac-9df5-dc6c77e36f78 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:48.501216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792cb8-9608-4bac-9df5-dc6c77e36f78 None admin] PATH_INFO: `/v3/projects/50d0b85329f04f0dbf62de05b9135235/groups/a2da46fa9db5406caf3ecedc74d9a566/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:48.503376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86792cb8-9608-4bac-9df5-dc6c77e36f78 None admin] RBAC: Authorizing `identity:create_grant(project_id=50d0b85329f04f0dbf62de05b9135235, group_id=a2da46fa9db5406caf3ecedc74d9a566, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:48.504985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86792cb8-9608-4bac-9df5-dc6c77e36f78 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:48.580544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 206/415] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jun 30 10:32:48 2022] PUT /identity/v3/projects/50d0b85329f04f0dbf62de05b9135235/groups/a2da46fa9db5406caf3ecedc74d9a566/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:32:48.733086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c001063-daa1-4f4f-99ba-666e45e187c7 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:48.733433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c001063-daa1-4f4f-99ba-666e45e187c7 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:48.733647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c001063-daa1-4f4f-99ba-666e45e187c7 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:48.735403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 210/416] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:48.741269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07d78-f65d-476a-804f-a6f9b8a58aa5 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:48.741569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07d78-f65d-476a-804f-a6f9b8a58aa5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:48.741864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07d78-f65d-476a-804f-a6f9b8a58aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:48.768099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-69c07d78-f65d-476a-804f-a6f9b8a58aa5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:48.769337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-69c07d78-f65d-476a-804f-a6f9b8a58aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:48.808981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:48.860438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 207/417] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:48.897966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c001063-daa1-4f4f-99ba-666e45e187c7 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:48.930063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:49.037345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b40ea-071a-47cf-b1c7-fa7612a887cf None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:49.037852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b40ea-071a-47cf-b1c7-fa7612a887cf None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:49.037982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b40ea-071a-47cf-b1c7-fa7612a887cf None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:49.040529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 208/418] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:49.044654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13098-9171-4ab1-9e06-6f23a4ce9228 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:49.045080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13098-9171-4ab1-9e06-6f23a4ce9228 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:49.045373 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13098-9171-4ab1-9e06-6f23a4ce9228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:49.053617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c001063-daa1-4f4f-99ba-666e45e187c7 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:49.073973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-bcb13098-9171-4ab1-9e06-6f23a4ce9228 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:49.075780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bcb13098-9171-4ab1-9e06-6f23a4ce9228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:49.097255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eacad-fdc6-460a-9916-0be57c5fb80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:49.098158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eacad-fdc6-460a-9916-0be57c5fb80c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:49.098449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eacad-fdc6-460a-9916-0be57c5fb80c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:49.098966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eacad-fdc6-460a-9916-0be57c5fb80c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:49.120321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eacad-fdc6-460a-9916-0be57c5fb80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-1d8eacad-fdc6-460a-9916-0be57c5fb80c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:49.132790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:49.133728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:49.134560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:49.141294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 211/419] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:49.145132 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eacad-fdc6-460a-9916-0be57c5fb80c None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:49.201951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 209/420] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:49.247899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb13098-9171-4ab1-9e06-6f23a4ce9228 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:49.274985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:49.312068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eacad-fdc6-460a-9916-0be57c5fb80c None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:49.348113 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552c61-b760-4ceb-8519-059e4d7e1600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:49.348794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552c61-b760-4ceb-8519-059e4d7e1600 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:49.349088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552c61-b760-4ceb-8519-059e4d7e1600 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:49.349643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552c61-b760-4ceb-8519-059e4d7e1600 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:49.350442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3552c61-b760-4ceb-8519-059e4d7e1600 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:49.351210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3552c61-b760-4ceb-8519-059e4d7e1600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:49.352862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3552c61-b760-4ceb-8519-059e4d7e1600 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:49.362654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 212/421] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:49.368793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552c61-b760-4ceb-8519-059e4d7e1600 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:49.419035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:49.447988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb13098-9171-4ab1-9e06-6f23a4ce9228 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:49.492269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b17c-ff1d-4184-a9e8-bb5ae9a38759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:49.493069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b17c-ff1d-4184-a9e8-bb5ae9a38759 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:49.493353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b17c-ff1d-4184-a9e8-bb5ae9a38759 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:49.493629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b17c-ff1d-4184-a9e8-bb5ae9a38759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:49.518617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b17c-ff1d-4184-a9e8-bb5ae9a38759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1806b17c-ff1d-4184-a9e8-bb5ae9a38759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:49.526354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:49.527269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:49.528176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 210/422] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:49.530867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552c61-b760-4ceb-8519-059e4d7e1600 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:49.533504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b17c-ff1d-4184-a9e8-bb5ae9a38759 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:49.606831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ddea1-3ae1-4cb9-acb4-bd2a89b66873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:49.607549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ddea1-3ae1-4cb9-acb4-bd2a89b66873 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:49.607841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ddea1-3ae1-4cb9-acb4-bd2a89b66873 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:49.608129 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ddea1-3ae1-4cb9-acb4-bd2a89b66873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:49.638352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:49.702373 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ddea1-3ae1-4cb9-acb4-bd2a89b66873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:49.703818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ddea1-3ae1-4cb9-acb4-bd2a89b66873 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:49.772071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b17c-ff1d-4184-a9e8-bb5ae9a38759 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:49.809331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 213/423] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:49.817719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ddea1-3ae1-4cb9-acb4-bd2a89b66873 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:49.878655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aacba-5b6f-44e5-9be0-22ef107c1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:49.879347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aacba-5b6f-44e5-9be0-22ef107c1b7f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:49.879639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aacba-5b6f-44e5-9be0-22ef107c1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:49.879923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aacba-5b6f-44e5-9be0-22ef107c1b7f None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:49.880687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aacba-5b6f-44e5-9be0-22ef107c1b7f None admin] RBAC: Adding query filter params (name=member) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:49.880999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aacba-5b6f-44e5-9be0-22ef107c1b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:49.881484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:49.882622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aacba-5b6f-44e5-9be0-22ef107c1b7f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:49.908280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 211/424] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:49.919382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aacba-5b6f-44e5-9be0-22ef107c1b7f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:49.932365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:49.948053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ddea1-3ae1-4cb9-acb4-bd2a89b66873 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:50.033135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aacba-5b6f-44e5-9be0-22ef107c1b7f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:50.055210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01236f-5e78-40b8-96bb-cf3438984aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:50.056101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01236f-5e78-40b8-96bb-cf3438984aaa None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.056389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01236f-5e78-40b8-96bb-cf3438984aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.056666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01236f-5e78-40b8-96bb-cf3438984aaa None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.057877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01236f-5e78-40b8-96bb-cf3438984aaa None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:50.059409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01236f-5e78-40b8-96bb-cf3438984aaa None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:50.061418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 214/425] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:49 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:50.068206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01236f-5e78-40b8-96bb-cf3438984aaa None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:50.073068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49a218-a994-4f46-8cf9-4cd78e24a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:50.074834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49a218-a994-4f46-8cf9-4cd78e24a66e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.075367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49a218-a994-4f46-8cf9-4cd78e24a66e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.075887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49a218-a994-4f46-8cf9-4cd78e24a66e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.157012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49a218-a994-4f46-8cf9-4cd78e24a66e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:50.158637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49a218-a994-4f46-8cf9-4cd78e24a66e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:50.178328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:50.270809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 212/426] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:32:50.272440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49a218-a994-4f46-8cf9-4cd78e24a66e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:50.289726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01236f-5e78-40b8-96bb-cf3438984aaa None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:50.311656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:50.334127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a69dc-4968-4f2e-a3d4-a9313853eb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:50.334994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a69dc-4968-4f2e-a3d4-a9313853eb0b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.335283 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a69dc-4968-4f2e-a3d4-a9313853eb0b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.335691 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a69dc-4968-4f2e-a3d4-a9313853eb0b None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.336871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a69dc-4968-4f2e-a3d4-a9313853eb0b None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:50.338503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a69dc-4968-4f2e-a3d4-a9313853eb0b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:50.345820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 215/427] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:50 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:50.347331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782c7c1-e7f8-4d53-a9eb-eead39d947a9 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.347626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782c7c1-e7f8-4d53-a9eb-eead39d947a9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.347909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782c7c1-e7f8-4d53-a9eb-eead39d947a9 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.349772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 216/428] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:50.350503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782c7c1-e7f8-4d53-a9eb-eead39d947a9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:50.386505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49a218-a994-4f46-8cf9-4cd78e24a66e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:50.398324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:50.422234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd94928-6cb0-4a93-80ae-9540a36b3ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:50.423158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd94928-6cb0-4a93-80ae-9540a36b3ef1 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.423449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd94928-6cb0-4a93-80ae-9540a36b3ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.423732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd94928-6cb0-4a93-80ae-9540a36b3ef1 None admin] PATH_INFO: `/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.424949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd94928-6cb0-4a93-80ae-9540a36b3ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=d0cdf4f8802048e4b1ba79f9cae3e998)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:50.426459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd94928-6cb0-4a93-80ae-9540a36b3ef1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:50.432661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 213/429] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:50 2022] GET /identity/v3/projects/d0cdf4f8802048e4b1ba79f9cae3e998 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:50.434528 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955f25e-fa75-4c2c-adea-8fa1d93a0560 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.434826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955f25e-fa75-4c2c-adea-8fa1d93a0560 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.435112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955f25e-fa75-4c2c-adea-8fa1d93a0560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.452899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b955f25e-fa75-4c2c-adea-8fa1d93a0560 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:50.454001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b955f25e-fa75-4c2c-adea-8fa1d93a0560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:50.466920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782c7c1-e7f8-4d53-a9eb-eead39d947a9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:50.504199 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740ecd9-e837-473f-b7ec-123897b0b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:50.504860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740ecd9-e837-473f-b7ec-123897b0b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.505148 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740ecd9-e837-473f-b7ec-123897b0b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.505432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740ecd9-e837-473f-b7ec-123897b0b0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.506299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740ecd9-e837-473f-b7ec-123897b0b0a5 None admin] RBAC: Adding query filter params (group.id=8750de98abfc4890b34b14e4e2a31622, role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:50.506615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740ecd9-e837-473f-b7ec-123897b0b0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:50.508045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740ecd9-e837-473f-b7ec-123897b0b0a5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:50.514947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 217/430] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:50 2022] GET /identity/v3/role_assignments?group.id=8750de98abfc4890b34b14e4e2a31622&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:50.519360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740ecd9-e837-473f-b7ec-123897b0b0a5 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:50.526671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 214/431] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:50.528487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d3756-83c0-4450-988d-aceda8016717 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.528963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d3756-83c0-4450-988d-aceda8016717 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.529421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d3756-83c0-4450-988d-aceda8016717 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.531249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 215/432] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:50.536160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67af7-1746-4821-ac48-2f2fcaf07494 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.538107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67af7-1746-4821-ac48-2f2fcaf07494 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.539303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67af7-1746-4821-ac48-2f2fcaf07494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.563194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-e8d67af7-1746-4821-ac48-2f2fcaf07494 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:50.564910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e8d67af7-1746-4821-ac48-2f2fcaf07494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:50.580768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:50.643842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740ecd9-e837-473f-b7ec-123897b0b0a5 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:50.662158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 216/433] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:50.663377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67af7-1746-4821-ac48-2f2fcaf07494 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:50.688083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028482a1-af5a-48ae-9cbb-52c8a4e02c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:50.688411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028482a1-af5a-48ae-9cbb-52c8a4e02c3d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.688767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028482a1-af5a-48ae-9cbb-52c8a4e02c3d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.689041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028482a1-af5a-48ae-9cbb-52c8a4e02c3d None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.690307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028482a1-af5a-48ae-9cbb-52c8a4e02c3d None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:50.691914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028482a1-af5a-48ae-9cbb-52c8a4e02c3d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:50.693555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 218/434] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:50 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:50.699792 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028482a1-af5a-48ae-9cbb-52c8a4e02c3d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:50.721281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:50.797142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67af7-1746-4821-ac48-2f2fcaf07494 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:50.831654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028482a1-af5a-48ae-9cbb-52c8a4e02c3d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:50.832615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c376-2bb9-4bc5-b614-c7633bff98a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:50.833409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c376-2bb9-4bc5-b614-c7633bff98a4 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.833695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c376-2bb9-4bc5-b614-c7633bff98a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.834001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c376-2bb9-4bc5-b614-c7633bff98a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.844371 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436c376-2bb9-4bc5-b614-c7633bff98a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:50.847204 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-4436c376-2bb9-4bc5-b614-c7633bff98a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:50.852259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:50.853105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:50.854317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 217/435] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:50.855223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c376-2bb9-4bc5-b614-c7633bff98a4 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:50.873585 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acea7b-05af-4174-bc6d-477887a68b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:50.883250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acea7b-05af-4174-bc6d-477887a68b1b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:50.883250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acea7b-05af-4174-bc6d-477887a68b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:50.883250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acea7b-05af-4174-bc6d-477887a68b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:50.883250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acea7b-05af-4174-bc6d-477887a68b1b None admin] RBAC: Adding query filter params (group.id=8750de98abfc4890b34b14e4e2a31622, role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:50.883250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acea7b-05af-4174-bc6d-477887a68b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:50.883250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acea7b-05af-4174-bc6d-477887a68b1b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:50.883840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 219/436] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:50 2022] GET /identity/v3/role_assignments?group.id=8750de98abfc4890b34b14e4e2a31622&scope.project.id=d0cdf4f8802048e4b1ba79f9cae3e998&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:50.884623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acea7b-05af-4174-bc6d-477887a68b1b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:50.994937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:51.000894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c376-2bb9-4bc5-b614-c7633bff98a4 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.009785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acea7b-05af-4174-bc6d-477887a68b1b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.049123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66ddfc-355e-4a8a-8b35-6e07fee2e4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.050101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66ddfc-355e-4a8a-8b35-6e07fee2e4ab None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.050459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa7885-eb06-48f5-b8f3-981d6fce0113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.050613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66ddfc-355e-4a8a-8b35-6e07fee2e4ab None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.050888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66ddfc-355e-4a8a-8b35-6e07fee2e4ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.051805 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa7885-eb06-48f5-b8f3-981d6fce0113 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.052289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa7885-eb06-48f5-b8f3-981d6fce0113 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.052720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa7885-eb06-48f5-b8f3-981d6fce0113 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.053844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa7885-eb06-48f5-b8f3-981d6fce0113 None admin] RBAC: Adding query filter params (name=member) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:51.054421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa7885-eb06-48f5-b8f3-981d6fce0113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:51.056009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa7885-eb06-48f5-b8f3-981d6fce0113 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:51.065294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66ddfc-355e-4a8a-8b35-6e07fee2e4ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:51.067781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 220/437] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:32:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:51.071627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303d18-4b67-48cc-8096-bc385ef53467 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.072099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303d18-4b67-48cc-8096-bc385ef53467 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.072801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303d18-4b67-48cc-8096-bc385ef53467 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.074305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 221/438] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:51.074937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303d18-4b67-48cc-8096-bc385ef53467 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-8f66ddfc-355e-4a8a-8b35-6e07fee2e4ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:51.076606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:51.077809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:51.079194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 218/439] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:51.084430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00452ca1-c0ff-404a-8c64-a5cc7bd48140 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.084900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00452ca1-c0ff-404a-8c64-a5cc7bd48140 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.085184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00452ca1-c0ff-404a-8c64-a5cc7bd48140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.106794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-00452ca1-c0ff-404a-8c64-a5cc7bd48140 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:51.108013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-00452ca1-c0ff-404a-8c64-a5cc7bd48140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:51.125431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:51.185174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 219/440] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:51.186126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00452ca1-c0ff-404a-8c64-a5cc7bd48140 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.205186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303d18-4b67-48cc-8096-bc385ef53467 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.249156 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6964918-359f-4404-ab82-aa30102a04d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.249908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6964918-359f-4404-ab82-aa30102a04d0 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.250230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6964918-359f-4404-ab82-aa30102a04d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.250504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6964918-359f-4404-ab82-aa30102a04d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.289793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:51.304727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00452ca1-c0ff-404a-8c64-a5cc7bd48140 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.332685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6964918-359f-4404-ab82-aa30102a04d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:51.334181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6964918-359f-4404-ab82-aa30102a04d0 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:51.344066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc1934-fe67-437a-983a-b59a6b2c6ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.345045 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc1934-fe67-437a-983a-b59a6b2c6ef0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.345543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc1934-fe67-437a-983a-b59a6b2c6ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.346150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc1934-fe67-437a-983a-b59a6b2c6ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.346918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc1934-fe67-437a-983a-b59a6b2c6ef0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:51.347234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc1934-fe67-437a-983a-b59a6b2c6ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:51.348631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc1934-fe67-437a-983a-b59a6b2c6ef0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:51.358468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 220/441] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:51.359092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc1934-fe67-437a-983a-b59a6b2c6ef0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.379022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:51.452775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 222/442] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:51.453781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6964918-359f-4404-ab82-aa30102a04d0 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.473468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc1934-fe67-437a-983a-b59a6b2c6ef0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.507313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4219399-6f0a-4f57-ae36-b1e00180ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.508102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4219399-6f0a-4f57-ae36-b1e00180ce12 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.508389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4219399-6f0a-4f57-ae36-b1e00180ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.508670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4219399-6f0a-4f57-ae36-b1e00180ce12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.519199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4219399-6f0a-4f57-ae36-b1e00180ce12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-b4219399-6f0a-4f57-ae36-b1e00180ce12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:51.526820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:51.528243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:51.529024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 221/443] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:51.530260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4219399-6f0a-4f57-ae36-b1e00180ce12 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.541360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:51.558105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6964918-359f-4404-ab82-aa30102a04d0 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.592061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ae52-0ca2-4baf-a483-fba16f4cf41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.592713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ae52-0ca2-4baf-a483-fba16f4cf41d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.593002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ae52-0ca2-4baf-a483-fba16f4cf41d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.593284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ae52-0ca2-4baf-a483-fba16f4cf41d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.601486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:51.627362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4219399-6f0a-4f57-ae36-b1e00180ce12 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.659939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720ae52-0ca2-4baf-a483-fba16f4cf41d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:51.660887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63221644-9a45-4218-bef6-96dab563ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.661411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720ae52-0ca2-4baf-a483-fba16f4cf41d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:51.661766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63221644-9a45-4218-bef6-96dab563ea7a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.662095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63221644-9a45-4218-bef6-96dab563ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.662376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63221644-9a45-4218-bef6-96dab563ea7a None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.663561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63221644-9a45-4218-bef6-96dab563ea7a None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:51.665011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63221644-9a45-4218-bef6-96dab563ea7a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:51.666746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 222/444] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:51.667499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63221644-9a45-4218-bef6-96dab563ea7a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.745098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:51.757263 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 223/445] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:51.758130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ae52-0ca2-4baf-a483-fba16f4cf41d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.766421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63221644-9a45-4218-bef6-96dab563ea7a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.800652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:51.801639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1046c-2d6d-47a1-99bf-34c5b41d22c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.802330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1046c-2d6d-47a1-99bf-34c5b41d22c6 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.802622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1046c-2d6d-47a1-99bf-34c5b41d22c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.802908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1046c-2d6d-47a1-99bf-34c5b41d22c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.803664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1046c-2d6d-47a1-99bf-34c5b41d22c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:51.803978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1046c-2d6d-47a1-99bf-34c5b41d22c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:51.805358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1046c-2d6d-47a1-99bf-34c5b41d22c6 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:51.813662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 223/446] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:51.814478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1046c-2d6d-47a1-99bf-34c5b41d22c6 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.860820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ae52-0ca2-4baf-a483-fba16f4cf41d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.899355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cf062-1bc6-43d4-bbfb-a68be25288d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.900234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf062-1bc6-43d4-bbfb-a68be25288d4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.900525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf062-1bc6-43d4-bbfb-a68be25288d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.900804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf062-1bc6-43d4-bbfb-a68be25288d4 None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.901991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cf062-1bc6-43d4-bbfb-a68be25288d4 None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:51.903476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cf062-1bc6-43d4-bbfb-a68be25288d4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:51.905309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 224/447] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:51.905847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cf062-1bc6-43d4-bbfb-a68be25288d4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.920097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1046c-2d6d-47a1-99bf-34c5b41d22c6 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:51.954162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd602f7-c5bf-439b-a289-7a0b72bd9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:51.955018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd602f7-c5bf-439b-a289-7a0b72bd9f4c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:51.955313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd602f7-c5bf-439b-a289-7a0b72bd9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:51.955588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd602f7-c5bf-439b-a289-7a0b72bd9f4c None admin] PATH_INFO: `/v3/projects/d88de896b4844391a04f85a2cc39591b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:51.956768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd602f7-c5bf-439b-a289-7a0b72bd9f4c None admin] RBAC: Authorizing `identity:get_project(project_id=d88de896b4844391a04f85a2cc39591b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:51.958257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd602f7-c5bf-439b-a289-7a0b72bd9f4c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:51.959926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 224/448] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/projects/d88de896b4844391a04f85a2cc39591b => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:51.960676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd602f7-c5bf-439b-a289-7a0b72bd9f4c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:51.971167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:52.010980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cf062-1bc6-43d4-bbfb-a68be25288d4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:52.018921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:52.044036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4efab-4e76-47af-a406-71a51802ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:52.045064 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4efab-4e76-47af-a406-71a51802ee68 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:52.045386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4efab-4e76-47af-a406-71a51802ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:52.045799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4efab-4e76-47af-a406-71a51802ee68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:52.059186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd602f7-c5bf-439b-a289-7a0b72bd9f4c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:52.091921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef6002-f48f-49d3-a962-57551b14146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:52.092562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6002-f48f-49d3-a962-57551b14146b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:52.092845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6002-f48f-49d3-a962-57551b14146b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:52.093121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6002-f48f-49d3-a962-57551b14146b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:52.093952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef6002-f48f-49d3-a962-57551b14146b None admin] RBAC: Adding query filter params (group.id=8750de98abfc4890b34b14e4e2a31622, role.id=217ceb9b91034918b3bb34c38120ab4f, scope.project.id=d88de896b4844391a04f85a2cc39591b) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:52.094275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef6002-f48f-49d3-a962-57551b14146b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:52.095791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef6002-f48f-49d3-a962-57551b14146b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:52.101795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 225/449] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/role_assignments?group.id=8750de98abfc4890b34b14e4e2a31622&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=217ceb9b91034918b3bb34c38120ab4f => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:52.102602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef6002-f48f-49d3-a962-57551b14146b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:52.128418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4efab-4e76-47af-a406-71a51802ee68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:52.129858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4efab-4e76-47af-a406-71a51802ee68 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:52.181712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:52.216008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef6002-f48f-49d3-a962-57551b14146b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:52.239109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 225/450] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:32:52.244529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4efab-4e76-47af-a406-71a51802ee68 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:52.253534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:52.254261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404561a0-dacb-41e2-9fc6-61e95c3f0a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:52.255126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404561a0-dacb-41e2-9fc6-61e95c3f0a1a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:52.255411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404561a0-dacb-41e2-9fc6-61e95c3f0a1a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:52.256488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404561a0-dacb-41e2-9fc6-61e95c3f0a1a None admin] PATH_INFO: `/v3/groups/8750de98abfc4890b34b14e4e2a31622` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:52.257694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404561a0-dacb-41e2-9fc6-61e95c3f0a1a None admin] RBAC: Authorizing `identity:get_group(group_id=8750de98abfc4890b34b14e4e2a31622)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:52.259175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404561a0-dacb-41e2-9fc6-61e95c3f0a1a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:52.260795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 226/451] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:52 2022] GET /identity/v3/groups/8750de98abfc4890b34b14e4e2a31622 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:52.266548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404561a0-dacb-41e2-9fc6-61e95c3f0a1a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:52.353656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4efab-4e76-47af-a406-71a51802ee68 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:52.390701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404561a0-dacb-41e2-9fc6-61e95c3f0a1a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:52.391951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7930449-d548-45ce-9e2a-4c500729ade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:52.393778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7930449-d548-45ce-9e2a-4c500729ade8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:52.394114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7930449-d548-45ce-9e2a-4c500729ade8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:52.394402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7930449-d548-45ce-9e2a-4c500729ade8 None admin] PATH_INFO: `/v3/projects/50d0b85329f04f0dbf62de05b9135235` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:52.395945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7930449-d548-45ce-9e2a-4c500729ade8 None admin] RBAC: Authorizing `identity:get_project(project_id=50d0b85329f04f0dbf62de05b9135235)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:52.397080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7930449-d548-45ce-9e2a-4c500729ade8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:52.399546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 226/452] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:32:52 2022] GET /identity/v3/projects/50d0b85329f04f0dbf62de05b9135235 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:52.405171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7930449-d548-45ce-9e2a-4c500729ade8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:52.435951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bbb33-b0c4-4542-aafe-9c428c6d0eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:52.436647 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bbb33-b0c4-4542-aafe-9c428c6d0eec None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:52.436913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bbb33-b0c4-4542-aafe-9c428c6d0eec None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:52.437192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bbb33-b0c4-4542-aafe-9c428c6d0eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:52.438115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bbb33-b0c4-4542-aafe-9c428c6d0eec None admin] RBAC: Adding query filter params (group.id=8750de98abfc4890b34b14e4e2a31622, role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=d88de896b4844391a04f85a2cc39591b) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:52.438368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bbb33-b0c4-4542-aafe-9c428c6d0eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:52.439946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bbb33-b0c4-4542-aafe-9c428c6d0eec None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:52.447046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 227/453] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:52 2022] GET /identity/v3/role_assignments?group.id=8750de98abfc4890b34b14e4e2a31622&scope.project.id=d88de896b4844391a04f85a2cc39591b&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:52.490144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:52.515854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7930449-d548-45ce-9e2a-4c500729ade8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:52.552265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0ccfd-d781-4e41-a9ab-a934af2aec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:52.553147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0ccfd-d781-4e41-a9ab-a934af2aec5b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:52.553435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0ccfd-d781-4e41-a9ab-a934af2aec5b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:52.553717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0ccfd-d781-4e41-a9ab-a934af2aec5b None admin] PATH_INFO: `/v3/groups/a2da46fa9db5406caf3ecedc74d9a566` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:52.555009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0ccfd-d781-4e41-a9ab-a934af2aec5b None admin] RBAC: Authorizing `identity:get_group(group_id=a2da46fa9db5406caf3ecedc74d9a566)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:52.556481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0ccfd-d781-4e41-a9ab-a934af2aec5b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:52.558172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 227/454] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jun 30 10:32:52 2022] GET /identity/v3/groups/a2da46fa9db5406caf3ecedc74d9a566 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:32:52.564698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bbb33-b0c4-4542-aafe-9c428c6d0eec None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:52.568727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:52.670517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bbb33-b0c4-4542-aafe-9c428c6d0eec None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:52.705851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fa6c1-8760-42ba-b629-fe3f1d43f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:52.706549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa6c1-8760-42ba-b629-fe3f1d43f643 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:52.706842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa6c1-8760-42ba-b629-fe3f1d43f643 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:52.707121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa6c1-8760-42ba-b629-fe3f1d43f643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:52.707963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa6c1-8760-42ba-b629-fe3f1d43f643 None admin] RBAC: Adding query filter params (group.id=a2da46fa9db5406caf3ecedc74d9a566, role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=50d0b85329f04f0dbf62de05b9135235) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:52.708284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa6c1-8760-42ba-b629-fe3f1d43f643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:52.709800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa6c1-8760-42ba-b629-fe3f1d43f643 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:52.716503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 228/455] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jun 30 10:32:52 2022] GET /identity/v3/role_assignments?group.id=a2da46fa9db5406caf3ecedc74d9a566&scope.project.id=50d0b85329f04f0dbf62de05b9135235&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:55.076607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280259-c1fb-4339-9fee-ebbe0acf47ba None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.077640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280259-c1fb-4339-9fee-ebbe0acf47ba None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.078161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280259-c1fb-4339-9fee-ebbe0acf47ba None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.079739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 228/456] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:55.084807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed47706-3662-4adb-8d78-4353bf9d3e4b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.085631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed47706-3662-4adb-8d78-4353bf9d3e4b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.086149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed47706-3662-4adb-8d78-4353bf9d3e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.108778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-aed47706-3662-4adb-8d78-4353bf9d3e4b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:55.110339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-aed47706-3662-4adb-8d78-4353bf9d3e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:55.198688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:55.203795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 229/457] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:55.254043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4280259-c1fb-4339-9fee-ebbe0acf47ba None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:55.391634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4280259-c1fb-4339-9fee-ebbe0acf47ba None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:55.415066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc583a4-507e-40eb-94d7-e648a76dd931 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.415700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc583a4-507e-40eb-94d7-e648a76dd931 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.416185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc583a4-507e-40eb-94d7-e648a76dd931 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.418110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 230/458] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:55.422895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea1d05-f64b-4b8f-a436-ed8a92debb28 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.423407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea1d05-f64b-4b8f-a436-ed8a92debb28 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.423888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea1d05-f64b-4b8f-a436-ed8a92debb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.438608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234c05f-0fdb-474c-a5b3-a59d4ffdfb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:55.439415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234c05f-0fdb-474c-a5b3-a59d4ffdfb75 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.439705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234c05f-0fdb-474c-a5b3-a59d4ffdfb75 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.439985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234c05f-0fdb-474c-a5b3-a59d4ffdfb75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.454285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234c05f-0fdb-474c-a5b3-a59d4ffdfb75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:55.455700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234c05f-0fdb-474c-a5b3-a59d4ffdfb75 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:55.457925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-19ea1d05-f64b-4b8f-a436-ed8a92debb28 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:55.459156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-19ea1d05-f64b-4b8f-a436-ed8a92debb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:55.466240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-d234c05f-0fdb-474c-a5b3-a59d4ffdfb75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:32:55.488278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:55.489217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:55.490063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:32:55.490063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:32:55.490063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:55.490063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:55.492571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 229/459] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:55.497808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234c05f-0fdb-474c-a5b3-a59d4ffdfb75 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:55.606072 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 231/460] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:55.654695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3f45b-94a7-4cd4-a013-25ab50543aa1 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.655033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3f45b-94a7-4cd4-a013-25ab50543aa1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.655267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3f45b-94a7-4cd4-a013-25ab50543aa1 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.656642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 232/461] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:55.661708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ee6ca-c2d4-42c4-a03e-b2eb2187344d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.662040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ee6ca-c2d4-42c4-a03e-b2eb2187344d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.662494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ee6ca-c2d4-42c4-a03e-b2eb2187344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.679903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234c05f-0fdb-474c-a5b3-a59d4ffdfb75 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:55.681442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-0c8ee6ca-c2d4-42c4-a03e-b2eb2187344d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:55.682941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0c8ee6ca-c2d4-42c4-a03e-b2eb2187344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:55.725002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95293373-166c-4347-b351-844442bb582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:55.725590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95293373-166c-4347-b351-844442bb582a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.725877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95293373-166c-4347-b351-844442bb582a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.726191 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95293373-166c-4347-b351-844442bb582a None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.726926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95293373-166c-4347-b351-844442bb582a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:55.727239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95293373-166c-4347-b351-844442bb582a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:55.728680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95293373-166c-4347-b351-844442bb582a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:55.750265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 230/462] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:55.751299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95293373-166c-4347-b351-844442bb582a None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:55.765816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 233/463] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:55.774909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ee6ca-c2d4-42c4-a03e-b2eb2187344d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:55.818552 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:55.852835 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:55.879607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95293373-166c-4347-b351-844442bb582a None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:55.912168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ee6ca-c2d4-42c4-a03e-b2eb2187344d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:55.934690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0017efa-e74d-40ed-9399-befe36100a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:55.936287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017efa-e74d-40ed-9399-befe36100a61 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.936727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017efa-e74d-40ed-9399-befe36100a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.937147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017efa-e74d-40ed-9399-befe36100a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.951134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017efa-e74d-40ed-9399-befe36100a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:55.953036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad23c6-c1bb-4ec1-8b3c-d6655dc1d5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:55.953036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad23c6-c1bb-4ec1-8b3c-d6655dc1d5e0 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.953036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad23c6-c1bb-4ec1-8b3c-d6655dc1d5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.953313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017efa-e74d-40ed-9399-befe36100a61 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:55.953404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad23c6-c1bb-4ec1-8b3c-d6655dc1d5e0 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.954328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad23c6-c1bb-4ec1-8b3c-d6655dc1d5e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:55.955881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad23c6-c1bb-4ec1-8b3c-d6655dc1d5e0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-c0017efa-e74d-40ed-9399-befe36100a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:32:55.982547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:55.983424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:55.984247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:32:55.984247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:32:55.984247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:55.984247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:55.984247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 231/464] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:55.984247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0017efa-e74d-40ed-9399-befe36100a61 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:56.057037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 234/465] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:55 2022] POST /identity/v3/users => generated 246 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:56.062413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad23c6-c1bb-4ec1-8b3c-d6655dc1d5e0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:56.095090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0017efa-e74d-40ed-9399-befe36100a61 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:56.107067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:56.155058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72d3ae-4696-419e-bb0b-8bab3145d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:56.157039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72d3ae-4696-419e-bb0b-8bab3145d1fe None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.157409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72d3ae-4696-419e-bb0b-8bab3145d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.157705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72d3ae-4696-419e-bb0b-8bab3145d1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.171885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72d3ae-4696-419e-bb0b-8bab3145d1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:56.173771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72d3ae-4696-419e-bb0b-8bab3145d1fe None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:56.195291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad23c6-c1bb-4ec1-8b3c-d6655dc1d5e0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-4f72d3ae-4696-419e-bb0b-8bab3145d1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:32:56.198083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:56.199479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:56.200315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:32:56.200315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:32:56.200315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:56.200315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:56.200315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 232/466] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:56.203289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7113d78-2467-4789-ae9b-80aa114750f4 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.203779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7113d78-2467-4789-ae9b-80aa114750f4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.204238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7113d78-2467-4789-ae9b-80aa114750f4 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.214255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 233/467] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:56.216587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7113d78-2467-4789-ae9b-80aa114750f4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:56.224760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:56.255635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab5564-3aef-46e3-9d55-f10ccb36622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:56.256314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab5564-3aef-46e3-9d55-f10ccb36622f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.256586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab5564-3aef-46e3-9d55-f10ccb36622f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.256871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab5564-3aef-46e3-9d55-f10ccb36622f None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.257610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab5564-3aef-46e3-9d55-f10ccb36622f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:56.257924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab5564-3aef-46e3-9d55-f10ccb36622f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:56.259464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab5564-3aef-46e3-9d55-f10ccb36622f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:56.273270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 235/468] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:56.278004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748d47-31b3-4aed-9c34-e8c3b72a83cb None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.278004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748d47-31b3-4aed-9c34-e8c3b72a83cb None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.278004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748d47-31b3-4aed-9c34-e8c3b72a83cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.297908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-da748d47-31b3-4aed-9c34-e8c3b72a83cb None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:56.299319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-da748d47-31b3-4aed-9c34-e8c3b72a83cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:56.358358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7113d78-2467-4789-ae9b-80aa114750f4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:56.383045 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 236/469] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:56.384139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748d47-31b3-4aed-9c34-e8c3b72a83cb None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:56.419036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fb14-4951-41d4-a95b-0209ebae1d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:56.419995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fb14-4951-41d4-a95b-0209ebae1d24 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.420285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fb14-4951-41d4-a95b-0209ebae1d24 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.420569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fb14-4951-41d4-a95b-0209ebae1d24 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.421471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fb14-4951-41d4-a95b-0209ebae1d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:56.422107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fb14-4951-41d4-a95b-0209ebae1d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:56.423503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fb14-4951-41d4-a95b-0209ebae1d24 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:56.440189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 234/470] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:56.441069 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fb14-4951-41d4-a95b-0209ebae1d24 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:56.465240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:56.514342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748d47-31b3-4aed-9c34-e8c3b72a83cb None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:56.517517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:56.551173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290477d3-173c-4265-8d91-83365c7210d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:56.551719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fb14-4951-41d4-a95b-0209ebae1d24 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:56.551829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290477d3-173c-4265-8d91-83365c7210d5 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.552125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290477d3-173c-4265-8d91-83365c7210d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.552408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290477d3-173c-4265-8d91-83365c7210d5 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.553133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290477d3-173c-4265-8d91-83365c7210d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:56.554627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290477d3-173c-4265-8d91-83365c7210d5 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:56.586916 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f091e2-06a4-4da4-82bb-6a0d69b8b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:56.587710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f091e2-06a4-4da4-82bb-6a0d69b8b359 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.587995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f091e2-06a4-4da4-82bb-6a0d69b8b359 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.588272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f091e2-06a4-4da4-82bb-6a0d69b8b359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.600009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f091e2-06a4-4da4-82bb-6a0d69b8b359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:56.601472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f091e2-06a4-4da4-82bb-6a0d69b8b359 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-c7f091e2-06a4-4da4-82bb-6a0d69b8b359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:32:56.618322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:56.619167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:56.625354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:32:56.625354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:32:56.625354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:56.625354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:56.625354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 235/471] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:56.625354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f091e2-06a4-4da4-82bb-6a0d69b8b359 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:56.663441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 237/472] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:56 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:56.665307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5900-a289-4eef-bd92-416929c7a2b3 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.666058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5900-a289-4eef-bd92-416929c7a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.666471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5900-a289-4eef-bd92-416929c7a2b3 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.670190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 238/473] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:56.671098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5900-a289-4eef-bd92-416929c7a2b3 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:56.707312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:56.748100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f091e2-06a4-4da4-82bb-6a0d69b8b359 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:56.789033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776449a-f208-4802-b609-adde5e33ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:56.789763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776449a-f208-4802-b609-adde5e33ab3d None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.790154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776449a-f208-4802-b609-adde5e33ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.790473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776449a-f208-4802-b609-adde5e33ab3d None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.791367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776449a-f208-4802-b609-adde5e33ab3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:56.793500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776449a-f208-4802-b609-adde5e33ab3d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:56.828263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5900-a289-4eef-bd92-416929c7a2b3 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:56.864889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78506b72-725a-4400-8cab-9066c342e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:56.865559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78506b72-725a-4400-8cab-9066c342e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.865850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78506b72-725a-4400-8cab-9066c342e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.866163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78506b72-725a-4400-8cab-9066c342e0a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.866892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78506b72-725a-4400-8cab-9066c342e0a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:56.867204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78506b72-725a-4400-8cab-9066c342e0a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:56.868604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78506b72-725a-4400-8cab-9066c342e0a2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:56.883150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 239/474] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:56.884455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e32a0-9c87-4d85-8075-7aa5f18587cd None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:56.884802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e32a0-9c87-4d85-8075-7aa5f18587cd None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:56.885090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e32a0-9c87-4d85-8075-7aa5f18587cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:56.903137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 236/475] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:56 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:56.904216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776449a-f208-4802-b609-adde5e33ab3d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:56.905905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-989e32a0-9c87-4d85-8075-7aa5f18587cd None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:56.907778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-989e32a0-9c87-4d85-8075-7aa5f18587cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:56.928593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:56.991951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 240/476] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:57.016509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e32a0-9c87-4d85-8075-7aa5f18587cd None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:57.040268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776449a-f208-4802-b609-adde5e33ab3d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:57.070809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:57.088674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e02ee-a7af-4e9c-9c02-cf49843511ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:57.089671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e02ee-a7af-4e9c-9c02-cf49843511ba None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:57.090181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e02ee-a7af-4e9c-9c02-cf49843511ba None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:57.090731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e02ee-a7af-4e9c-9c02-cf49843511ba None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:57.091750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e02ee-a7af-4e9c-9c02-cf49843511ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:57.093211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e02ee-a7af-4e9c-9c02-cf49843511ba None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:57.133231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e32a0-9c87-4d85-8075-7aa5f18587cd None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:57.171412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:57.172420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:57.172889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:57.173347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:57.174305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:57.175902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:57.196354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 237/477] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:32:56 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:32:57.213260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.sql.core [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 10:32:57.213260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 10:32:57.213260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [parameters: {'id': '57d9bb788a684865b2382d86e61e99a4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 10:32:57.213260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86804) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application result.read() Jun 30 10:32:57.233594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return ref.to_dict() Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:32:57.234602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application yield resource Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise self.value Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application session.commit() Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 10:32:57.235593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self.session.flush() Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application compat.raise_( Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 10:32:57.236450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:32:57.237349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application result.read() Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:32:57.238196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [parameters: {'id': '57d9bb788a684865b2382d86e61e99a4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:57.239009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 10:32:57.240017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:57.242525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 241/478] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 10:32:57 2022] POST /identity/v3/roles => generated 144 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:32:57.248654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e02ee-a7af-4e9c-9c02-cf49843511ba None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:57.393883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e02ee-a7af-4e9c-9c02-cf49843511ba None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:57.439264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2487bc-5506-45e3-b8a9-e6a9ed932163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:57.440254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2487bc-5506-45e3-b8a9-e6a9ed932163 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:57.440637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2487bc-5506-45e3-b8a9-e6a9ed932163 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:57.441036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2487bc-5506-45e3-b8a9-e6a9ed932163 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:57.451921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2487bc-5506-45e3-b8a9-e6a9ed932163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-df2487bc-5506-45e3-b8a9-e6a9ed932163 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:57.460369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:57.461447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:32:57.462488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:57.465081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 238/479] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:32:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:57.470775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:57.494434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:57.584492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1bc25-49b7-448c-bb41-5ede2fee0b37 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:57.621725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6bb2d-83c9-4e48-a2b5-a3a9f5db10aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:57.622775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6bb2d-83c9-4e48-a2b5-a3a9f5db10aa None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:57.623259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6bb2d-83c9-4e48-a2b5-a3a9f5db10aa None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:57.623762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6bb2d-83c9-4e48-a2b5-a3a9f5db10aa None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:57.624736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6bb2d-83c9-4e48-a2b5-a3a9f5db10aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:57.625246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6bb2d-83c9-4e48-a2b5-a3a9f5db10aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:57.626851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6bb2d-83c9-4e48-a2b5-a3a9f5db10aa None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:57.636710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 242/480] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:32:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:58.544581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e003b-5cb2-4c9c-9a3e-c2e3504b9dbf None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:58.545127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e003b-5cb2-4c9c-9a3e-c2e3504b9dbf None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:58.545127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e003b-5cb2-4c9c-9a3e-c2e3504b9dbf None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:58.546824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 239/481] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:58.551716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46979c-ac43-403d-9ed1-7878a199448e None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:58.552093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46979c-ac43-403d-9ed1-7878a199448e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:58.552282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46979c-ac43-403d-9ed1-7878a199448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:58.575100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-9d46979c-ac43-403d-9ed1-7878a199448e None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:58.576301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9d46979c-ac43-403d-9ed1-7878a199448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:58.663680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 243/482] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:58.701970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e003b-5cb2-4c9c-9a3e-c2e3504b9dbf None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:58.768087 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:58.844874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e003b-5cb2-4c9c-9a3e-c2e3504b9dbf None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:58.891705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b2bec-53a0-49aa-a80c-9e515ff68a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:58.892525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b2bec-53a0-49aa-a80c-9e515ff68a33 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:58.892816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b2bec-53a0-49aa-a80c-9e515ff68a33 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:58.893098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b2bec-53a0-49aa-a80c-9e515ff68a33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:58.909729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b2bec-53a0-49aa-a80c-9e515ff68a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-5a8b2bec-53a0-49aa-a80c-9e515ff68a33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:58.917653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:58.918595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:32:58.919382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:58.923545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 240/483] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:32:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:58.924541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46979c-ac43-403d-9ed1-7878a199448e None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:58.932949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:59.003313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d41b2-fd79-4f5a-bcd6-b348eefa7023 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.003635 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d41b2-fd79-4f5a-bcd6-b348eefa7023 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.003874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d41b2-fd79-4f5a-bcd6-b348eefa7023 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.005261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 241/484] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:59.010499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc1478-0f74-46c2-97d2-e2bcaefdbcf1 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.010790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc1478-0f74-46c2-97d2-e2bcaefdbcf1 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.011117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc1478-0f74-46c2-97d2-e2bcaefdbcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.044582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46979c-ac43-403d-9ed1-7878a199448e None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:59.050922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-63cc1478-0f74-46c2-97d2-e2bcaefdbcf1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:59.052209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-63cc1478-0f74-46c2-97d2-e2bcaefdbcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:59.080047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69033ca-a7f9-4e22-9d48-d93658703667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:59.080725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69033ca-a7f9-4e22-9d48-d93658703667 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.081014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69033ca-a7f9-4e22-9d48-d93658703667 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.081295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69033ca-a7f9-4e22-9d48-d93658703667 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.082076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69033ca-a7f9-4e22-9d48-d93658703667 None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:59.082391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69033ca-a7f9-4e22-9d48-d93658703667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:59.083785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69033ca-a7f9-4e22-9d48-d93658703667 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:59.092705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 244/485] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:32:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:59.097613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69033ca-a7f9-4e22-9d48-d93658703667 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:59.178312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:59.181753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 242/486] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:32:59.213238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69033ca-a7f9-4e22-9d48-d93658703667 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:59.217293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc1478-0f74-46c2-97d2-e2bcaefdbcf1 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:59.251272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436fcb7-6fd8-4c1b-99bf-6b64ae6b8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:59.252226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436fcb7-6fd8-4c1b-99bf-6b64ae6b8d37 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.252619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436fcb7-6fd8-4c1b-99bf-6b64ae6b8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.252907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436fcb7-6fd8-4c1b-99bf-6b64ae6b8d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.258707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:59.265540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436fcb7-6fd8-4c1b-99bf-6b64ae6b8d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:59.267375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436fcb7-6fd8-4c1b-99bf-6b64ae6b8d37 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1436fcb7-6fd8-4c1b-99bf-6b64ae6b8d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:32:59.285533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:59.286423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:59.287260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:32:59.287260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:32:59.287260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:59.287260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:59.289538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 245/487] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:59.298859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436fcb7-6fd8-4c1b-99bf-6b64ae6b8d37 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:59.332601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc1478-0f74-46c2-97d2-e2bcaefdbcf1 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:59.372264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77588f-0ded-4641-8a4e-0d52217e10b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:59.372977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77588f-0ded-4641-8a4e-0d52217e10b0 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.373267 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77588f-0ded-4641-8a4e-0d52217e10b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.373541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77588f-0ded-4641-8a4e-0d52217e10b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.384382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77588f-0ded-4641-8a4e-0d52217e10b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-af77588f-0ded-4641-8a4e-0d52217e10b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:59.392337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:59.394506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:32:59.396234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:59.402729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 243/488] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:32:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:59.402729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296428ff-c3bc-4cb5-b50c-fd8ccea6ef11 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.402729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296428ff-c3bc-4cb5-b50c-fd8ccea6ef11 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.402729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296428ff-c3bc-4cb5-b50c-fd8ccea6ef11 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.402729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 244/489] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:59.402729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296428ff-c3bc-4cb5-b50c-fd8ccea6ef11 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:59.451968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436fcb7-6fd8-4c1b-99bf-6b64ae6b8d37 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:59.479370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:59.498933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239f93-0d5e-4edd-af78-c4c4b9a26461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:59.499659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239f93-0d5e-4edd-af78-c4c4b9a26461 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.499943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239f93-0d5e-4edd-af78-c4c4b9a26461 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.500227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239f93-0d5e-4edd-af78-c4c4b9a26461 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.504351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29239f93-0d5e-4edd-af78-c4c4b9a26461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:59.504351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29239f93-0d5e-4edd-af78-c4c4b9a26461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:59.504351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29239f93-0d5e-4edd-af78-c4c4b9a26461 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:59.504858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:59.522195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296428ff-c3bc-4cb5-b50c-fd8ccea6ef11 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:59.522537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 246/490] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:59.524086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d05d8-31c2-4217-b141-16db8ecb5703 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.524575 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d05d8-31c2-4217-b141-16db8ecb5703 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.525075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d05d8-31c2-4217-b141-16db8ecb5703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.542943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1c5d05d8-31c2-4217-b141-16db8ecb5703 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:59.544482 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1c5d05d8-31c2-4217-b141-16db8ecb5703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:59.561850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86276f3f-ae9e-44dc-b5ef-2deb1c94eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:59.562552 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86276f3f-ae9e-44dc-b5ef-2deb1c94eb1a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.562839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86276f3f-ae9e-44dc-b5ef-2deb1c94eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.563117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86276f3f-ae9e-44dc-b5ef-2deb1c94eb1a None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.564126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86276f3f-ae9e-44dc-b5ef-2deb1c94eb1a None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:32:59.564439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86276f3f-ae9e-44dc-b5ef-2deb1c94eb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:59.566206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86276f3f-ae9e-44dc-b5ef-2deb1c94eb1a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:59.581450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 245/491] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:32:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:32:59.581450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86276f3f-ae9e-44dc-b5ef-2deb1c94eb1a None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:59.623508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 247/492] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:32:59.624962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d05d8-31c2-4217-b141-16db8ecb5703 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:59.725894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86276f3f-ae9e-44dc-b5ef-2deb1c94eb1a None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:59.733701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d05d8-31c2-4217-b141-16db8ecb5703 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:59.746420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:59.766252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd5a21-e530-44e0-b74d-007bbb5c5752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:59.767047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd5a21-e530-44e0-b74d-007bbb5c5752 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.767332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd5a21-e530-44e0-b74d-007bbb5c5752 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.767610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd5a21-e530-44e0-b74d-007bbb5c5752 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.775399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd5a21-e530-44e0-b74d-007bbb5c5752 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:59.776948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd5a21-e530-44e0-b74d-007bbb5c5752 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:59.778064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69175594-6dd3-4efe-b7fb-eef1b79e4d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:59.779250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69175594-6dd3-4efe-b7fb-eef1b79e4d86 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.780191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69175594-6dd3-4efe-b7fb-eef1b79e4d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.780962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69175594-6dd3-4efe-b7fb-eef1b79e4d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.793453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69175594-6dd3-4efe-b7fb-eef1b79e4d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-a4bd5a21-e530-44e0-b74d-007bbb5c5752 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:32:59.794561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:59.795460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:59.796346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 246/493] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 10:32:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:59.798162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69175594-6dd3-4efe-b7fb-eef1b79e4d86 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:59.801867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd5a21-e530-44e0-b74d-007bbb5c5752 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-69175594-6dd3-4efe-b7fb-eef1b79e4d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:32:59.825001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:59.825896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:59.826848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:32:59.826848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:32:59.826848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:32:59.826848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:32:59.827079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:59.827818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 248/494] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:59.828198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69175594-6dd3-4efe-b7fb-eef1b79e4d86 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:59.915709 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd5a21-e530-44e0-b74d-007bbb5c5752 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:59.951366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e08284-bfc9-49e5-87d6-5247982b9cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:59.952399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e08284-bfc9-49e5-87d6-5247982b9cdb None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:59.952853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e08284-bfc9-49e5-87d6-5247982b9cdb None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:59.953266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e08284-bfc9-49e5-87d6-5247982b9cdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:59.962369 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69175594-6dd3-4efe-b7fb-eef1b79e4d86 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:59.963813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e08284-bfc9-49e5-87d6-5247982b9cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-10e08284-bfc9-49e5-87d6-5247982b9cdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:32:59.971594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:32:59.972654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:32:59.973626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:32:59.976225 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 247/495] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:32:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:32:59.977274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e08284-bfc9-49e5-87d6-5247982b9cdb None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.009145 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc65aad-ad23-4158-9aaa-697fbe3a4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:00.010071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc65aad-ad23-4158-9aaa-697fbe3a4c81 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.010502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc65aad-ad23-4158-9aaa-697fbe3a4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.010966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc65aad-ad23-4158-9aaa-697fbe3a4c81 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.012248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc65aad-ad23-4158-9aaa-697fbe3a4c81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:00.012778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc65aad-ad23-4158-9aaa-697fbe3a4c81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:00.014468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc65aad-ad23-4158-9aaa-697fbe3a4c81 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:00.057067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:00.062055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 249/496] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 10:32:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:00.063037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc65aad-ad23-4158-9aaa-697fbe3a4c81 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.084505 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e08284-bfc9-49e5-87d6-5247982b9cdb None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:00.087060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:00.121052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b8dca-2e3a-43c0-97a5-466a00a4cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:00.121726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b8dca-2e3a-43c0-97a5-466a00a4cf51 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.122039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b8dca-2e3a-43c0-97a5-466a00a4cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.122321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b8dca-2e3a-43c0-97a5-466a00a4cf51 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.123048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b8dca-2e3a-43c0-97a5-466a00a4cf51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:00.123356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b8dca-2e3a-43c0-97a5-466a00a4cf51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:00.124747 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b8dca-2e3a-43c0-97a5-466a00a4cf51 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:00.137689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 248/497] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:00.142314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b8dca-2e3a-43c0-97a5-466a00a4cf51 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.176020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc65aad-ad23-4158-9aaa-697fbe3a4c81 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:00.213166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd218b8b-1fc1-4640-a737-10e1b649906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:00.214782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd218b8b-1fc1-4640-a737-10e1b649906d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.215276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd218b8b-1fc1-4640-a737-10e1b649906d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.215841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd218b8b-1fc1-4640-a737-10e1b649906d None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.216843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd218b8b-1fc1-4640-a737-10e1b649906d None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:00.217356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd218b8b-1fc1-4640-a737-10e1b649906d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:00.218999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd218b8b-1fc1-4640-a737-10e1b649906d None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:00.228200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 250/498] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:00.229454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd218b8b-1fc1-4640-a737-10e1b649906d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.247594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b8dca-2e3a-43c0-97a5-466a00a4cf51 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:00.284542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd46ae-f276-4e0f-b227-00cdefd83160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:00.284957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd46ae-f276-4e0f-b227-00cdefd83160 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.285240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd46ae-f276-4e0f-b227-00cdefd83160 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.285513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd46ae-f276-4e0f-b227-00cdefd83160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.288158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:00.318867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:00.337699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd218b8b-1fc1-4640-a737-10e1b649906d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:00.355495 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd46ae-f276-4e0f-b227-00cdefd83160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:00.356973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd46ae-f276-4e0f-b227-00cdefd83160 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:00.379771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a8c67-eba9-4391-9cb5-f45af6a2005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:00.380568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8c67-eba9-4391-9cb5-f45af6a2005b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.380850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8c67-eba9-4391-9cb5-f45af6a2005b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.381270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8c67-eba9-4391-9cb5-f45af6a2005b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.389226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a8c67-eba9-4391-9cb5-f45af6a2005b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:00.390793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a8c67-eba9-4391-9cb5-f45af6a2005b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-523a8c67-eba9-4391-9cb5-f45af6a2005b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:00.406615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:00.407530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:00.408431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 251/499] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:00.409003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a8c67-eba9-4391-9cb5-f45af6a2005b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.462522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 249/500] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:00.463749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2079a7-b287-4f13-aa58-7bbfe8cc3c0c None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.464041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2079a7-b287-4f13-aa58-7bbfe8cc3c0c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.464855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2079a7-b287-4f13-aa58-7bbfe8cc3c0c None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.466145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 250/501] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:00.467194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644851d5-37f6-453b-ac4d-e278692d0517 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.467566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644851d5-37f6-453b-ac4d-e278692d0517 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.467820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644851d5-37f6-453b-ac4d-e278692d0517 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.469036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 251/502] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:00.469718 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644851d5-37f6-453b-ac4d-e278692d0517 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.504886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:00.517563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a8c67-eba9-4391-9cb5-f45af6a2005b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:00.551518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f936e1-b007-4d1c-a187-6f6547037dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:00.552308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f936e1-b007-4d1c-a187-6f6547037dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.552594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f936e1-b007-4d1c-a187-6f6547037dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.552869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f936e1-b007-4d1c-a187-6f6547037dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.563401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f936e1-b007-4d1c-a187-6f6547037dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:00.564856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f936e1-b007-4d1c-a187-6f6547037dd6 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:00.566578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:00.569414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644851d5-37f6-453b-ac4d-e278692d0517 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-35f936e1-b007-4d1c-a187-6f6547037dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:00.582738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:00.583588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:00.584708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:00.584708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:00.584708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:00.584708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:00.584708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 252/503] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:00.584708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f936e1-b007-4d1c-a187-6f6547037dd6 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.605785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b13fa0-6abc-4e49-b9f8-c4b714475edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:00.606516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b13fa0-6abc-4e49-b9f8-c4b714475edb None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.606766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b13fa0-6abc-4e49-b9f8-c4b714475edb None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.610741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b13fa0-6abc-4e49-b9f8-c4b714475edb None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.610741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b13fa0-6abc-4e49-b9f8-c4b714475edb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:00.610741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b13fa0-6abc-4e49-b9f8-c4b714475edb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:00.610741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b13fa0-6abc-4e49-b9f8-c4b714475edb None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:00.685448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 252/504] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 10:33:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:00.686745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01fef9-7115-4cf6-9868-90f45cb8ff97 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.687050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01fef9-7115-4cf6-9868-90f45cb8ff97 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.687332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01fef9-7115-4cf6-9868-90f45cb8ff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.703874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6d01fef9-7115-4cf6-9868-90f45cb8ff97 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:00.704847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f936e1-b007-4d1c-a187-6f6547037dd6 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:00.705303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6d01fef9-7115-4cf6-9868-90f45cb8ff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:00.738795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4f44b-51cc-4127-854a-32ec3c45a79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:00.739515 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4f44b-51cc-4127-854a-32ec3c45a79a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.739805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4f44b-51cc-4127-854a-32ec3c45a79a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.740085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4f44b-51cc-4127-854a-32ec3c45a79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.750687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4f44b-51cc-4127-854a-32ec3c45a79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:00.752163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4f44b-51cc-4127-854a-32ec3c45a79a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:00.769411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 253/505] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-4ff4f44b-51cc-4127-854a-32ec3c45a79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:00.769541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:00.770358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:00.771195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:00.771195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:00.771195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:00.771195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:00.771411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d490da-937c-422c-9604-ca9c10653973 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.771411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d490da-937c-422c-9604-ca9c10653973 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.771411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d490da-937c-422c-9604-ca9c10653973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.774221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 253/506] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:00.775365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4f44b-51cc-4127-854a-32ec3c45a79a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.796271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a3d490da-937c-422c-9604-ca9c10653973 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:00.797473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a3d490da-937c-422c-9604-ca9c10653973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:00.813854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:00.822883 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:00.864639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 254/507] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:00.865472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d490da-937c-422c-9604-ca9c10653973 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.878499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4f44b-51cc-4127-854a-32ec3c45a79a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:00.913884 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135127-0ba1-41ac-9c65-ec06113f2267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:00.914580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135127-0ba1-41ac-9c65-ec06113f2267 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:00.914873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135127-0ba1-41ac-9c65-ec06113f2267 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:00.915157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135127-0ba1-41ac-9c65-ec06113f2267 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:00.915886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa135127-0ba1-41ac-9c65-ec06113f2267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:00.916202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa135127-0ba1-41ac-9c65-ec06113f2267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:00.917605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa135127-0ba1-41ac-9c65-ec06113f2267 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:00.929282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 254/508] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:00.930094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135127-0ba1-41ac-9c65-ec06113f2267 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:00.972606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d490da-937c-422c-9604-ca9c10653973 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.006161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e123f-4464-47ee-8a2e-1c87b0a01f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.006745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e123f-4464-47ee-8a2e-1c87b0a01f45 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.007031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e123f-4464-47ee-8a2e-1c87b0a01f45 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.007370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e123f-4464-47ee-8a2e-1c87b0a01f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.028588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.031273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135127-0ba1-41ac-9c65-ec06113f2267 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.038568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.064628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307c62-2573-478e-8b4a-87cb30213102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.065313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307c62-2573-478e-8b4a-87cb30213102 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.065601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307c62-2573-478e-8b4a-87cb30213102 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.065887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307c62-2573-478e-8b4a-87cb30213102 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.066655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307c62-2573-478e-8b4a-87cb30213102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:01.066965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307c62-2573-478e-8b4a-87cb30213102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.068386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307c62-2573-478e-8b4a-87cb30213102 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.074703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e123f-4464-47ee-8a2e-1c87b0a01f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.076158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e123f-4464-47ee-8a2e-1c87b0a01f45 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.080039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 255/509] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:01.080964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307c62-2573-478e-8b4a-87cb30213102 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.173550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 255/510] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:01.174421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e123f-4464-47ee-8a2e-1c87b0a01f45 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.179933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307c62-2573-478e-8b4a-87cb30213102 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.214913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5c977-0a7b-4273-86e9-a9e833f91724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.215701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c977-0a7b-4273-86e9-a9e833f91724 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.215991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c977-0a7b-4273-86e9-a9e833f91724 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.216272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c977-0a7b-4273-86e9-a9e833f91724 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.225226 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.226551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5c977-0a7b-4273-86e9-a9e833f91724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-c6a5c977-0a7b-4273-86e9-a9e833f91724 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:01.234792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:01.235700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:01.236488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 256/511] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:01.237161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5c977-0a7b-4273-86e9-a9e833f91724 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.266327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.272730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e123f-4464-47ee-8a2e-1c87b0a01f45 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.306217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe380-748e-46df-8f74-243ff9d93b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.307012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe380-748e-46df-8f74-243ff9d93b46 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.307304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe380-748e-46df-8f74-243ff9d93b46 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.307612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe380-748e-46df-8f74-243ff9d93b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.318088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafe380-748e-46df-8f74-243ff9d93b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.319544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafe380-748e-46df-8f74-243ff9d93b46 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-4fafe380-748e-46df-8f74-243ff9d93b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:01.336907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:01.337905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:01.338797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:01.338797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:01.338797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:01.338797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:01.339001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5c977-0a7b-4273-86e9-a9e833f91724 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.339107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 256/512] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:01.339107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe380-748e-46df-8f74-243ff9d93b46 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.373545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe5a2-f71e-4598-bd78-982716a0c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.374372 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe5a2-f71e-4598-bd78-982716a0c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.374665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe5a2-f71e-4598-bd78-982716a0c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.374947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe5a2-f71e-4598-bd78-982716a0c4b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.382412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe5a2-f71e-4598-bd78-982716a0c4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.383867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe5a2-f71e-4598-bd78-982716a0c4b0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1d5fe5a2-f71e-4598-bd78-982716a0c4b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:01.397847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:01.398803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:01.399694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 257/513] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:01.400267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe5a2-f71e-4598-bd78-982716a0c4b0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.444619 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe380-748e-46df-8f74-243ff9d93b46 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.446889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.477136 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86491b-0170-4a91-aa86-b52dc21fc48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.478021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86491b-0170-4a91-aa86-b52dc21fc48b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.478564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86491b-0170-4a91-aa86-b52dc21fc48b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.479375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86491b-0170-4a91-aa86-b52dc21fc48b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.486843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86491b-0170-4a91-aa86-b52dc21fc48b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.487462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.488312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86491b-0170-4a91-aa86-b52dc21fc48b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.502288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe5a2-f71e-4598-bd78-982716a0c4b0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-3b86491b-0170-4a91-aa86-b52dc21fc48b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:01.503689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:01.504682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:01.505651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:01.505651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:01.505651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:01.505651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:01.505651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:01.505651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:01.505651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:01.505651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:01.505651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 257/514] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:01.506758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86491b-0170-4a91-aa86-b52dc21fc48b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.536427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4cd3-1514-4995-9054-642172e1f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.537219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4cd3-1514-4995-9054-642172e1f6ca None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.537509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4cd3-1514-4995-9054-642172e1f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.537786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4cd3-1514-4995-9054-642172e1f6ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.549561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4cd3-1514-4995-9054-642172e1f6ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.551067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4cd3-1514-4995-9054-642172e1f6ca None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-f70b4cd3-1514-4995-9054-642172e1f6ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:01.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:01.569464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:01.570344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:01.570344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:01.570344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:01.570344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:01.570344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 258/515] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:01.570605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4cd3-1514-4995-9054-642172e1f6ca None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.608456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86491b-0170-4a91-aa86-b52dc21fc48b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.642591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b064a1-41d9-4532-b5fd-36346b220336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.643252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b064a1-41d9-4532-b5fd-36346b220336 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.643534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b064a1-41d9-4532-b5fd-36346b220336 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.643813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b064a1-41d9-4532-b5fd-36346b220336 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.644560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b064a1-41d9-4532-b5fd-36346b220336 None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:01.644870 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b064a1-41d9-4532-b5fd-36346b220336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.646316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b064a1-41d9-4532-b5fd-36346b220336 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.654886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 258/516] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:01.655660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b064a1-41d9-4532-b5fd-36346b220336 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.676013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4cd3-1514-4995-9054-642172e1f6ca None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.681594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.709805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03676a-c717-48b6-b605-3d23160541e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.710643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03676a-c717-48b6-b605-3d23160541e8 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.710933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03676a-c717-48b6-b605-3d23160541e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.711209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03676a-c717-48b6-b605-3d23160541e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.711956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03676a-c717-48b6-b605-3d23160541e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:01.712270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03676a-c717-48b6-b605-3d23160541e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.713654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03676a-c717-48b6-b605-3d23160541e8 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.721258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.726600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 259/517] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:01.732654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03676a-c717-48b6-b605-3d23160541e8 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.757545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b064a1-41d9-4532-b5fd-36346b220336 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.796830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e758-1361-457a-aee4-268b1d3468df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.797415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e758-1361-457a-aee4-268b1d3468df None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.797702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e758-1361-457a-aee4-268b1d3468df None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.798022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e758-1361-457a-aee4-268b1d3468df None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.798868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1e758-1361-457a-aee4-268b1d3468df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:01.799181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1e758-1361-457a-aee4-268b1d3468df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.800641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1e758-1361-457a-aee4-268b1d3468df None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.817691 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 259/518] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:01.818537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e758-1361-457a-aee4-268b1d3468df None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.827386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03676a-c717-48b6-b605-3d23160541e8 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.861828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588f3c0-eccc-4d43-865b-f69404798fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.862510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588f3c0-eccc-4d43-865b-f69404798fee None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.862795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588f3c0-eccc-4d43-865b-f69404798fee None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.863068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588f3c0-eccc-4d43-865b-f69404798fee None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.863847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588f3c0-eccc-4d43-865b-f69404798fee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:01.864158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588f3c0-eccc-4d43-865b-f69404798fee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.865583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588f3c0-eccc-4d43-865b-f69404798fee None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.883268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 260/519] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:01.883942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588f3c0-eccc-4d43-865b-f69404798fee None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.908900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.924740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e758-1361-457a-aee4-268b1d3468df None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.943689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:01.958024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0729df-022a-4f7e-b3c6-2bb8039b3bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.958687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0729df-022a-4f7e-b3c6-2bb8039b3bdb None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.958975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0729df-022a-4f7e-b3c6-2bb8039b3bdb None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.959257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0729df-022a-4f7e-b3c6-2bb8039b3bdb None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.959991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0729df-022a-4f7e-b3c6-2bb8039b3bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:01.960299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0729df-022a-4f7e-b3c6-2bb8039b3bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.961675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0729df-022a-4f7e-b3c6-2bb8039b3bdb None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.974130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 260/520] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:01.974955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0729df-022a-4f7e-b3c6-2bb8039b3bdb None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.991593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588f3c0-eccc-4d43-865b-f69404798fee None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.025201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b20653-6bb0-4e08-8d16-9215369b2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:02.026016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20653-6bb0-4e08-8d16-9215369b2a77 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:02.026306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20653-6bb0-4e08-8d16-9215369b2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:02.027210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20653-6bb0-4e08-8d16-9215369b2a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:02.037832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b20653-6bb0-4e08-8d16-9215369b2a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:02.039330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b20653-6bb0-4e08-8d16-9215369b2a77 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-96b20653-6bb0-4e08-8d16-9215369b2a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:02.056128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:02.057138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:02.058289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:02.058289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:02.058289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:02.058289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:02.058289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 261/521] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:02.058289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b20653-6bb0-4e08-8d16-9215369b2a77 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:02.074603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0729df-022a-4f7e-b3c6-2bb8039b3bdb None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.108499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18449580-0677-46ed-b526-e5927a4374ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:02.109178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18449580-0677-46ed-b526-e5927a4374ef None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:02.109467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18449580-0677-46ed-b526-e5927a4374ef None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:02.109749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18449580-0677-46ed-b526-e5927a4374ef None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:02.110631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18449580-0677-46ed-b526-e5927a4374ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:02.112092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18449580-0677-46ed-b526-e5927a4374ef None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:02.165340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b20653-6bb0-4e08-8d16-9215369b2a77 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.176147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:02.195057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:02.210034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 261/522] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:33:01 2022] POST /identity/v3/users => generated 247 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:02.210253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26415a95-6987-4afa-a0e2-8328d150b23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:02.210253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26415a95-6987-4afa-a0e2-8328d150b23a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:02.210253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26415a95-6987-4afa-a0e2-8328d150b23a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:02.210519 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18449580-0677-46ed-b526-e5927a4374ef None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:02.210591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26415a95-6987-4afa-a0e2-8328d150b23a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:02.326582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26415a95-6987-4afa-a0e2-8328d150b23a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:02.328839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26415a95-6987-4afa-a0e2-8328d150b23a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:02.349477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18449580-0677-46ed-b526-e5927a4374ef None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.392414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40206e6-e3be-496e-bf7a-abfa3146fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:02.393822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40206e6-e3be-496e-bf7a-abfa3146fc3b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:02.394135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40206e6-e3be-496e-bf7a-abfa3146fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:02.394419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40206e6-e3be-496e-bf7a-abfa3146fc3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:02.395265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40206e6-e3be-496e-bf7a-abfa3146fc3b None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=0f46cf6eb4a44a71bda92cb212a8009c) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:02.395582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40206e6-e3be-496e-bf7a-abfa3146fc3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:02.397022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40206e6-e3be-496e-bf7a-abfa3146fc3b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:02.403921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 262/523] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:02 2022] GET /identity/v3/role_assignments?user.id=0f46cf6eb4a44a71bda92cb212a8009c&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:02.405279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40206e6-e3be-496e-bf7a-abfa3146fc3b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:02.451538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 262/524] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:02.452005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26415a95-6987-4afa-a0e2-8328d150b23a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:02.467740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:02.513993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:02.557311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40206e6-e3be-496e-bf7a-abfa3146fc3b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.598035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26415a95-6987-4afa-a0e2-8328d150b23a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.603026 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969baebc-bb87-4fbe-b31d-90c35ef9a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:02.604237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969baebc-bb87-4fbe-b31d-90c35ef9a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:02.604804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969baebc-bb87-4fbe-b31d-90c35ef9a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:02.605244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969baebc-bb87-4fbe-b31d-90c35ef9a0e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:02.613202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969baebc-bb87-4fbe-b31d-90c35ef9a0e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:02.615451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969baebc-bb87-4fbe-b31d-90c35ef9a0e0 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-969baebc-bb87-4fbe-b31d-90c35ef9a0e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:02.631056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:02.631924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:02.632753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:02.632753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:02.632753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:02.632753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:02.632753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:02.632753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:02.632753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:02.632753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:02.635350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 263/525] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:02.636700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969baebc-bb87-4fbe-b31d-90c35ef9a0e0 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:02.637593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec15d4-cb41-445d-8d6b-80f775323583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:02.638120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec15d4-cb41-445d-8d6b-80f775323583 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:02.638406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec15d4-cb41-445d-8d6b-80f775323583 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:02.638680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec15d4-cb41-445d-8d6b-80f775323583 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:02.639470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec15d4-cb41-445d-8d6b-80f775323583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:02.639846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec15d4-cb41-445d-8d6b-80f775323583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:02.641206 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec15d4-cb41-445d-8d6b-80f775323583 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:02.657831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 263/526] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:02.658788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec15d4-cb41-445d-8d6b-80f775323583 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:02.750535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969baebc-bb87-4fbe-b31d-90c35ef9a0e0 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.751422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:02.777558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:02.789771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08daab4-397e-498e-910f-5f937591630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:02.790801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08daab4-397e-498e-910f-5f937591630d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:02.791183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08daab4-397e-498e-910f-5f937591630d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:02.791561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08daab4-397e-498e-910f-5f937591630d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:02.793398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec15d4-cb41-445d-8d6b-80f775323583 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.803662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08daab4-397e-498e-910f-5f937591630d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:02.805327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08daab4-397e-498e-910f-5f937591630d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-e08daab4-397e-498e-910f-5f937591630d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:02.825518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:02.826649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:02.827540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:02.827540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:02.827540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:02.827540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:02.829360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 264/527] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:02.829360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08daab4-397e-498e-910f-5f937591630d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:02.837570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d07f9-8503-4dc3-97fb-4c678f8f67cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:02.838279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d07f9-8503-4dc3-97fb-4c678f8f67cc None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:02.838574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d07f9-8503-4dc3-97fb-4c678f8f67cc None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:02.838854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d07f9-8503-4dc3-97fb-4c678f8f67cc None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:02.839723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d07f9-8503-4dc3-97fb-4c678f8f67cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:02.840038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d07f9-8503-4dc3-97fb-4c678f8f67cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:02.841475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d07f9-8503-4dc3-97fb-4c678f8f67cc None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:02.856737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 264/528] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:02.857594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d07f9-8503-4dc3-97fb-4c678f8f67cc None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:02.950243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08daab4-397e-498e-910f-5f937591630d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.987115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d07f9-8503-4dc3-97fb-4c678f8f67cc None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:02.999578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a42aa-1126-4fc7-933c-66249059df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:03.001240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a42aa-1126-4fc7-933c-66249059df76 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.001679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a42aa-1126-4fc7-933c-66249059df76 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.002150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a42aa-1126-4fc7-933c-66249059df76 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.012256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a42aa-1126-4fc7-933c-66249059df76 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:03.014625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a42aa-1126-4fc7-933c-66249059df76 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:03.019723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:03.025630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d80ec9-f298-4183-a6a0-a27befc7ae9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:03.026413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d80ec9-f298-4183-a6a0-a27befc7ae9f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.026819 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d80ec9-f298-4183-a6a0-a27befc7ae9f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.027166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d80ec9-f298-4183-a6a0-a27befc7ae9f None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.028025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d80ec9-f298-4183-a6a0-a27befc7ae9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:03.028399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d80ec9-f298-4183-a6a0-a27befc7ae9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:03.030053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d80ec9-f298-4183-a6a0-a27befc7ae9f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-961a42aa-1126-4fc7-933c-66249059df76 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:03.035293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:03.037097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:33:03.038020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:03.039476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 265/529] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:03.039690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a42aa-1126-4fc7-933c-66249059df76 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:03.049345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 265/530] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:03.050477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d80ec9-f298-4183-a6a0-a27befc7ae9f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:03.087190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:03.174551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a42aa-1126-4fc7-933c-66249059df76 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:03.178072 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d80ec9-f298-4183-a6a0-a27befc7ae9f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:03.210378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b721acf-e62b-4763-9c78-d11bd02399b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:03.211119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721acf-e62b-4763-9c78-d11bd02399b8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.211403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721acf-e62b-4763-9c78-d11bd02399b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.211677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721acf-e62b-4763-9c78-d11bd02399b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.212514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721acf-e62b-4763-9c78-d11bd02399b8 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=9e839d1074f24a5ba7a552472e167067) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:03.212848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721acf-e62b-4763-9c78-d11bd02399b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:03.214890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721acf-e62b-4763-9c78-d11bd02399b8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:03.225965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 266/531] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:03 2022] GET /identity/v3/role_assignments?user.id=9e839d1074f24a5ba7a552472e167067&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:03.225965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b721acf-e62b-4763-9c78-d11bd02399b8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:03.227539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b34b5-d69b-491a-ae68-7b2642d8c139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:03.228241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b34b5-d69b-491a-ae68-7b2642d8c139 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.228524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b34b5-d69b-491a-ae68-7b2642d8c139 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.228797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b34b5-d69b-491a-ae68-7b2642d8c139 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.229750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b34b5-d69b-491a-ae68-7b2642d8c139 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:03.230093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b34b5-d69b-491a-ae68-7b2642d8c139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:03.231597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b34b5-d69b-491a-ae68-7b2642d8c139 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:03.271155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 266/532] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jun 30 10:33:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:03.276640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b34b5-d69b-491a-ae68-7b2642d8c139 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:03.390356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:03.422736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:03.426449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b721acf-e62b-4763-9c78-d11bd02399b8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:03.463463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b34b5-d69b-491a-ae68-7b2642d8c139 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:03.468808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ed5fb-3ddc-42be-8357-637b0e0caa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:03.469624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ed5fb-3ddc-42be-8357-637b0e0caa3b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.469909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ed5fb-3ddc-42be-8357-637b0e0caa3b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.470239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ed5fb-3ddc-42be-8357-637b0e0caa3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.478667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ed5fb-3ddc-42be-8357-637b0e0caa3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:03.480858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ed5fb-3ddc-42be-8357-637b0e0caa3b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-862ed5fb-3ddc-42be-8357-637b0e0caa3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:03.497736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:03.498658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:03.499513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:03.499513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:03.499513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:03.499513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:03.499513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:03.499513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:03.499513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:03.499513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:03.499916 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 267/533] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:03.504914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ed5fb-3ddc-42be-8357-637b0e0caa3b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:03.548517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b3cb3-0ce3-430e-9853-cf8d77bab942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:03.549187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3cb3-0ce3-430e-9853-cf8d77bab942 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.549472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3cb3-0ce3-430e-9853-cf8d77bab942 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.549747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3cb3-0ce3-430e-9853-cf8d77bab942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.642203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b3cb3-0ce3-430e-9853-cf8d77bab942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:03.643957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b3cb3-0ce3-430e-9853-cf8d77bab942 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:03.714419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:03.755090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ed5fb-3ddc-42be-8357-637b0e0caa3b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:03.789725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 267/534] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:03.795532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b3cb3-0ce3-430e-9853-cf8d77bab942 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:03.818644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c858464-0bf0-48d4-aa13-3e99e6838964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:03.819777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c858464-0bf0-48d4-aa13-3e99e6838964 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.821142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c858464-0bf0-48d4-aa13-3e99e6838964 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.822410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c858464-0bf0-48d4-aa13-3e99e6838964 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.823632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c858464-0bf0-48d4-aa13-3e99e6838964 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:03.825190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c858464-0bf0-48d4-aa13-3e99e6838964 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:03.827065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c858464-0bf0-48d4-aa13-3e99e6838964 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:03.866478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 268/535] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:03.867666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c858464-0bf0-48d4-aa13-3e99e6838964 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:03.907067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:03.988261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b3cb3-0ce3-430e-9853-cf8d77bab942 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:04.059451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f3157-4980-4f05-80ec-30dee69ed50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:04.060259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f3157-4980-4f05-80ec-30dee69ed50e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.060548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f3157-4980-4f05-80ec-30dee69ed50e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.060830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f3157-4980-4f05-80ec-30dee69ed50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.065002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c858464-0bf0-48d4-aa13-3e99e6838964 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:04.085723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f3157-4980-4f05-80ec-30dee69ed50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:04.087262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f3157-4980-4f05-80ec-30dee69ed50e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-e72f3157-4980-4f05-80ec-30dee69ed50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:04.118816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:04.119781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:04.120653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:04.120653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:04.120653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:04.120653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:04.122233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:04.135990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 268/536] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:04.137219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f3157-4980-4f05-80ec-30dee69ed50e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:04.144333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621ec31-4635-4de2-894c-9ad2c722cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:04.144999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621ec31-4635-4de2-894c-9ad2c722cd83 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.145287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621ec31-4635-4de2-894c-9ad2c722cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.145566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621ec31-4635-4de2-894c-9ad2c722cd83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.146460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621ec31-4635-4de2-894c-9ad2c722cd83 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=19fd3da30bdb477e99dbbc2f7075f161) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:04.146779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621ec31-4635-4de2-894c-9ad2c722cd83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:04.148234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621ec31-4635-4de2-894c-9ad2c722cd83 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:04.161986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 269/537] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:03 2022] GET /identity/v3/role_assignments?user.id=19fd3da30bdb477e99dbbc2f7075f161&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:04.328016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f3157-4980-4f05-80ec-30dee69ed50e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:04.381074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91499-daee-4c35-84a7-a4cfcadd9a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:04.381760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91499-daee-4c35-84a7-a4cfcadd9a14 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.382081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91499-daee-4c35-84a7-a4cfcadd9a14 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.382365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91499-daee-4c35-84a7-a4cfcadd9a14 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.383111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91499-daee-4c35-84a7-a4cfcadd9a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:04.383428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91499-daee-4c35-84a7-a4cfcadd9a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:04.384839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91499-daee-4c35-84a7-a4cfcadd9a14 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:04.400844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 269/538] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:04.406122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621ec31-4635-4de2-894c-9ad2c722cd83 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:04.530478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:04.540271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55567c-145b-4704-a62d-12dd45f05aa8 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.540554 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55567c-145b-4704-a62d-12dd45f05aa8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.540862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55567c-145b-4704-a62d-12dd45f05aa8 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.543046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 270/539] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:04.548127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413a66-4fd3-4c93-b32d-89c94ad107d6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.548424 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413a66-4fd3-4c93-b32d-89c94ad107d6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.548709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413a66-4fd3-4c93-b32d-89c94ad107d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.553873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621ec31-4635-4de2-894c-9ad2c722cd83 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:04.568599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-21413a66-4fd3-4c93-b32d-89c94ad107d6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:04.569801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-21413a66-4fd3-4c93-b32d-89c94ad107d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:04.612866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bf935-8ad6-48e6-9d6f-8ef5b0c354ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:04.613719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf935-8ad6-48e6-9d6f-8ef5b0c354ef None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.614050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf935-8ad6-48e6-9d6f-8ef5b0c354ef None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.614341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf935-8ad6-48e6-9d6f-8ef5b0c354ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.631270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bf935-8ad6-48e6-9d6f-8ef5b0c354ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:04.632750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bf935-8ad6-48e6-9d6f-8ef5b0c354ef None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-307bf935-8ad6-48e6-9d6f-8ef5b0c354ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:04.647433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:04.648259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:04.649089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:04.649089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:04.649089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:04.649089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:04.649089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:04.649089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:04.649089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:04.649089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:04.649089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 270/540] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:04.654014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbd4b-e003-4df7-a158-2a35ce9f5bdb None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.654014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbd4b-e003-4df7-a158-2a35ce9f5bdb None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.654014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbd4b-e003-4df7-a158-2a35ce9f5bdb None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.654014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 271/541] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:04.656042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cbd4b-e003-4df7-a158-2a35ce9f5bdb None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:04.693993 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:04.702313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 271/542] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:33:04.710323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2009bd-4e0f-4f1b-8da6-7fdcfc8114e8 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.721089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2009bd-4e0f-4f1b-8da6-7fdcfc8114e8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.721089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2009bd-4e0f-4f1b-8da6-7fdcfc8114e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.744317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1f2009bd-4e0f-4f1b-8da6-7fdcfc8114e8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:04.745780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1f2009bd-4e0f-4f1b-8da6-7fdcfc8114e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:04.772424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cbd4b-e003-4df7-a158-2a35ce9f5bdb None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:04.811070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0100823-a7b5-4eef-a220-37eac7839b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:04.812152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0100823-a7b5-4eef-a220-37eac7839b35 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.812675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0100823-a7b5-4eef-a220-37eac7839b35 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.813174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0100823-a7b5-4eef-a220-37eac7839b35 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.814197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0100823-a7b5-4eef-a220-37eac7839b35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:04.814689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0100823-a7b5-4eef-a220-37eac7839b35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:04.816303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0100823-a7b5-4eef-a220-37eac7839b35 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:04.818269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 272/543] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:04.819341 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2009bd-4e0f-4f1b-8da6-7fdcfc8114e8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:04.835165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 272/544] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:04.836599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0100823-a7b5-4eef-a220-37eac7839b35 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:04.858430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:04.927587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2009bd-4e0f-4f1b-8da6-7fdcfc8114e8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:04.949231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:04.957090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0100823-a7b5-4eef-a220-37eac7839b35 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:04.965470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9e7a-656e-40e7-8c7b-738df22df816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:04.966390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9e7a-656e-40e7-8c7b-738df22df816 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:04.967101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9e7a-656e-40e7-8c7b-738df22df816 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:04.967101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9e7a-656e-40e7-8c7b-738df22df816 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:04.978696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e9e7a-656e-40e7-8c7b-738df22df816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-9e6e9e7a-656e-40e7-8c7b-738df22df816 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:04.987726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:04.988637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:04.989411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:04.993914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 273/545] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:04.995428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9e7a-656e-40e7-8c7b-738df22df816 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:05.000758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e2d84-ab10-4b91-8824-b382d8489be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:05.001698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e2d84-ab10-4b91-8824-b382d8489be3 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.002191 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e2d84-ab10-4b91-8824-b382d8489be3 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.002695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e2d84-ab10-4b91-8824-b382d8489be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.003722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e2d84-ab10-4b91-8824-b382d8489be3 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=719afb6dcb154119beb18d2f1974fe2e) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:05.004228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e2d84-ab10-4b91-8824-b382d8489be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:05.006015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e2d84-ab10-4b91-8824-b382d8489be3 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:05.022132 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 273/546] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:04 2022] GET /identity/v3/role_assignments?user.id=719afb6dcb154119beb18d2f1974fe2e&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:05.023572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e2d84-ab10-4b91-8824-b382d8489be3 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:05.138690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9e7a-656e-40e7-8c7b-738df22df816 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:05.164846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:05.193360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c441b37-61b8-4fc2-9916-b9dc3875b4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:05.194227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c441b37-61b8-4fc2-9916-b9dc3875b4b5 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.194565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c441b37-61b8-4fc2-9916-b9dc3875b4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.194863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c441b37-61b8-4fc2-9916-b9dc3875b4b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.207953 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c441b37-61b8-4fc2-9916-b9dc3875b4b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-7c441b37-61b8-4fc2-9916-b9dc3875b4b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:05.217104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:05.218075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:05.219049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:05.220076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 274/547] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:05.229212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c441b37-61b8-4fc2-9916-b9dc3875b4b5 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:05.236994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e2d84-ab10-4b91-8824-b382d8489be3 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:05.285081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de3779-0f0c-402c-b7e6-26b2190e4f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:05.286160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3779-0f0c-402c-b7e6-26b2190e4f68 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.286672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3779-0f0c-402c-b7e6-26b2190e4f68 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.287160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3779-0f0c-402c-b7e6-26b2190e4f68 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.288412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:05.289417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de3779-0f0c-402c-b7e6-26b2190e4f68 None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:05.291196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de3779-0f0c-402c-b7e6-26b2190e4f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:05.293053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de3779-0f0c-402c-b7e6-26b2190e4f68 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:05.304243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 274/548] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:05.309415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de3779-0f0c-402c-b7e6-26b2190e4f68 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:05.428847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de3779-0f0c-402c-b7e6-26b2190e4f68 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:05.440399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c441b37-61b8-4fc2-9916-b9dc3875b4b5 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:05.463990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:05.472060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62ec9e-d6bd-4e18-a73e-925938a4e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:05.473499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62ec9e-d6bd-4e18-a73e-925938a4e102 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.474234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62ec9e-d6bd-4e18-a73e-925938a4e102 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.474677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62ec9e-d6bd-4e18-a73e-925938a4e102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.490230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62ec9e-d6bd-4e18-a73e-925938a4e102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:05.490837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354136a0-5fe6-4e67-9829-eeed059c24ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:05.491517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354136a0-5fe6-4e67-9829-eeed059c24ed None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.491806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354136a0-5fe6-4e67-9829-eeed059c24ed None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.492089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354136a0-5fe6-4e67-9829-eeed059c24ed None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.492846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354136a0-5fe6-4e67-9829-eeed059c24ed None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:05.493160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354136a0-5fe6-4e67-9829-eeed059c24ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:05.493465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62ec9e-d6bd-4e18-a73e-925938a4e102 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:05.494747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354136a0-5fe6-4e67-9829-eeed059c24ed None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:05.506157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 275/549] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:05.510596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e30e-5f7b-4735-8101-31f45d0e26e9 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.510596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e30e-5f7b-4735-8101-31f45d0e26e9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.510596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e30e-5f7b-4735-8101-31f45d0e26e9 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.512010 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 276/550] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:05.513968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e30e-5f7b-4735-8101-31f45d0e26e9 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-9a62ec9e-d6bd-4e18-a73e-925938a4e102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:05.522482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:05.523355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:05.524820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:05.524820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:05.524820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:05.524820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:05.524820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 275/551] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:05.525315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffe8bb-9d50-4d8b-8fee-fcc34cdf48cf None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.525608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffe8bb-9d50-4d8b-8fee-fcc34cdf48cf None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.525893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffe8bb-9d50-4d8b-8fee-fcc34cdf48cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.543467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-30ffe8bb-9d50-4d8b-8fee-fcc34cdf48cf None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:05.544682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-30ffe8bb-9d50-4d8b-8fee-fcc34cdf48cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:05.634014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 276/552] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:05.634910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffe8bb-9d50-4d8b-8fee-fcc34cdf48cf None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:05.641093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e30e-5f7b-4735-8101-31f45d0e26e9 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:05.642936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:05.681777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb805-dc19-4f3b-a278-e7e39bdd50ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:05.683069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb805-dc19-4f3b-a278-e7e39bdd50ad None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.683412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb805-dc19-4f3b-a278-e7e39bdd50ad None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.683651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb805-dc19-4f3b-a278-e7e39bdd50ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.695396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb805-dc19-4f3b-a278-e7e39bdd50ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:05.696858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb805-dc19-4f3b-a278-e7e39bdd50ad None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-63dbb805-dc19-4f3b-a278-e7e39bdd50ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:05.715706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:05.716655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:05.717526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:05.717526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:05.717526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:05.717526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:05.717526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 277/553] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:05.717792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb805-dc19-4f3b-a278-e7e39bdd50ad None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:05.763527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffe8bb-9d50-4d8b-8fee-fcc34cdf48cf None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:05.794752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:05.806610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151f77a-80f8-4954-ad91-ffdb26a6e033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:05.807308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f77a-80f8-4954-ad91-ffdb26a6e033 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.808234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f77a-80f8-4954-ad91-ffdb26a6e033 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.808513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f77a-80f8-4954-ad91-ffdb26a6e033 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.809568 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151f77a-80f8-4954-ad91-ffdb26a6e033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:05.810000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151f77a-80f8-4954-ad91-ffdb26a6e033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:05.811518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151f77a-80f8-4954-ad91-ffdb26a6e033 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:05.824042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 277/554] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:05.825093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151f77a-80f8-4954-ad91-ffdb26a6e033 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:05.831467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb805-dc19-4f3b-a278-e7e39bdd50ad None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:05.867260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a74e7-ac12-4c7e-9b4b-b8da72efb7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:05.868090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a74e7-ac12-4c7e-9b4b-b8da72efb7ad None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.868380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a74e7-ac12-4c7e-9b4b-b8da72efb7ad None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.868657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a74e7-ac12-4c7e-9b4b-b8da72efb7ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.879682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a74e7-ac12-4c7e-9b4b-b8da72efb7ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-c48a74e7-ac12-4c7e-9b4b-b8da72efb7ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:05.887526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:05.888557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:05.889437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:05.896778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 278/555] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:05.900091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a74e7-ac12-4c7e-9b4b-b8da72efb7ad None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:05.919869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:05.941080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151f77a-80f8-4954-ad91-ffdb26a6e033 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:05.978698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4fb44-59cd-4225-9ef0-e3eb64f06661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:05.979577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4fb44-59cd-4225-9ef0-e3eb64f06661 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.979817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4fb44-59cd-4225-9ef0-e3eb64f06661 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.980096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4fb44-59cd-4225-9ef0-e3eb64f06661 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.980885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4fb44-59cd-4225-9ef0-e3eb64f06661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:05.981127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4fb44-59cd-4225-9ef0-e3eb64f06661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:05.982665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4fb44-59cd-4225-9ef0-e3eb64f06661 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.000054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 278/556] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:06.000054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4fb44-59cd-4225-9ef0-e3eb64f06661 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.035266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a74e7-ac12-4c7e-9b4b-b8da72efb7ad None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.042804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:06.080863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22217-9f7c-4635-9e1a-13556628c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.082324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22217-9f7c-4635-9e1a-13556628c02a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.082838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22217-9f7c-4635-9e1a-13556628c02a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.083462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22217-9f7c-4635-9e1a-13556628c02a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.094400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe22217-9f7c-4635-9e1a-13556628c02a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.096674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe22217-9f7c-4635-9e1a-13556628c02a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-6fe22217-9f7c-4635-9e1a-13556628c02a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:06.115376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:06.116345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:06.117725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:06.118282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4fb44-59cd-4225-9ef0-e3eb64f06661 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.119558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 279/557] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:06.121445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22217-9f7c-4635-9e1a-13556628c02a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.162871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6e74-375c-440c-b9fa-b3caaa208a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.164457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6e74-375c-440c-b9fa-b3caaa208a9f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.164965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6e74-375c-440c-b9fa-b3caaa208a9f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.165888 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6e74-375c-440c-b9fa-b3caaa208a9f None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.166910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6e74-375c-440c-b9fa-b3caaa208a9f None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:06.167811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6e74-375c-440c-b9fa-b3caaa208a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.169703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6e74-375c-440c-b9fa-b3caaa208a9f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.181542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 279/558] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:06.183211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6e74-375c-440c-b9fa-b3caaa208a9f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.208299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:06.240699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22217-9f7c-4635-9e1a-13556628c02a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.288702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:06.294062 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a0bd-03bc-45d8-863b-d6b693e22cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.295183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a0bd-03bc-45d8-863b-d6b693e22cab None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.295636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a0bd-03bc-45d8-863b-d6b693e22cab None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.296078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a0bd-03bc-45d8-863b-d6b693e22cab None admin] PATH_INFO: `/v3/users/swift` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.296183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6e74-375c-440c-b9fa-b3caaa208a9f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.306392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a0bd-03bc-45d8-863b-d6b693e22cab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.309256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a0bd-03bc-45d8-863b-d6b693e22cab None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-4758a0bd-03bc-45d8-863b-d6b693e22cab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:06.328971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:06.330061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:06.330995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:06.333188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 280/559] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:06.333188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a0bd-03bc-45d8-863b-d6b693e22cab None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.339294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8438-0eb4-4805-b190-2719c025aca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.340015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8438-0eb4-4805-b190-2719c025aca5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.340284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8438-0eb4-4805-b190-2719c025aca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.340562 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8438-0eb4-4805-b190-2719c025aca5 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.341427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c8438-0eb4-4805-b190-2719c025aca5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:06.341746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c8438-0eb4-4805-b190-2719c025aca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.343992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c8438-0eb4-4805-b190-2719c025aca5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.362164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 280/560] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 10:33:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:06.362955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8438-0eb4-4805-b190-2719c025aca5 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.454095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a0bd-03bc-45d8-863b-d6b693e22cab None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.489556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a90c59-8d31-4477-b40f-5883c04e802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.490323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90c59-8d31-4477-b40f-5883c04e802e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.490612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90c59-8d31-4477-b40f-5883c04e802e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.490895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90c59-8d31-4477-b40f-5883c04e802e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.491973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8438-0eb4-4805-b190-2719c025aca5 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.492837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:06.503699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a90c59-8d31-4477-b40f-5883c04e802e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.512484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a90c59-8d31-4477-b40f-5883c04e802e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-31a90c59-8d31-4477-b40f-5883c04e802e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:06.523442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:06.525601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:06.527686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:06.527686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:06.527686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:06.527686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:06.527686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 281/561] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:06.527686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a90c59-8d31-4477-b40f-5883c04e802e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.543010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51740c7e-8db0-40e6-bb76-ed9efc98aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.543889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740c7e-8db0-40e6-bb76-ed9efc98aae9 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.544324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740c7e-8db0-40e6-bb76-ed9efc98aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.544759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740c7e-8db0-40e6-bb76-ed9efc98aae9 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.545603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51740c7e-8db0-40e6-bb76-ed9efc98aae9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:06.545924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51740c7e-8db0-40e6-bb76-ed9efc98aae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.547378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51740c7e-8db0-40e6-bb76-ed9efc98aae9 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.567398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 281/562] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 10:33:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:06.568656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732840b9-ccf8-4a05-bb67-08b6ed4e2181 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.568950 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732840b9-ccf8-4a05-bb67-08b6ed4e2181 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.569231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732840b9-ccf8-4a05-bb67-08b6ed4e2181 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.572076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 282/563] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:06.572076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732840b9-ccf8-4a05-bb67-08b6ed4e2181 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.584767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:06.638016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a90c59-8d31-4477-b40f-5883c04e802e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.675438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94757f4-779e-4744-8521-13604ae5a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.676235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94757f4-779e-4744-8521-13604ae5a481 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.676526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94757f4-779e-4744-8521-13604ae5a481 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.676810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94757f4-779e-4744-8521-13604ae5a481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.680219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732840b9-ccf8-4a05-bb67-08b6ed4e2181 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.688505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94757f4-779e-4744-8521-13604ae5a481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.690010 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94757f4-779e-4744-8521-13604ae5a481 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-d94757f4-779e-4744-8521-13604ae5a481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:06.707362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:06.708495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:06.709496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:06.709496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:06.709496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:06.709496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:06.709496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 282/564] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:06.709785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94757f4-779e-4744-8521-13604ae5a481 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.725860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7337f-6482-44c8-8fbd-a85828bc044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.726570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7337f-6482-44c8-8fbd-a85828bc044a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.726935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7337f-6482-44c8-8fbd-a85828bc044a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.727221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7337f-6482-44c8-8fbd-a85828bc044a None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.727966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7337f-6482-44c8-8fbd-a85828bc044a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:06.728278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7337f-6482-44c8-8fbd-a85828bc044a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.730275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7337f-6482-44c8-8fbd-a85828bc044a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.743799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 283/565] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:06.745101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f59b4-4f56-4b73-a2b8-6c5512acaa2d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.745890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f59b4-4f56-4b73-a2b8-6c5512acaa2d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.746197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f59b4-4f56-4b73-a2b8-6c5512acaa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.768327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-534f59b4-4f56-4b73-a2b8-6c5512acaa2d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:06.769718 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-534f59b4-4f56-4b73-a2b8-6c5512acaa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:06.775476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:06.844229 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94757f4-779e-4744-8521-13604ae5a481 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.845550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:06.861963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 284/566] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:06.861963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f59b4-4f56-4b73-a2b8-6c5512acaa2d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.899236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b76c53-413c-4bbd-b156-16136f78d2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.900138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b76c53-413c-4bbd-b156-16136f78d2a5 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.900560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b76c53-413c-4bbd-b156-16136f78d2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.900962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b76c53-413c-4bbd-b156-16136f78d2a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.980405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b76c53-413c-4bbd-b156-16136f78d2a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.981904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b76c53-413c-4bbd-b156-16136f78d2a5 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.982928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f59b4-4f56-4b73-a2b8-6c5512acaa2d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.020029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2572c37-9976-4a9d-83ca-95a646a3206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.020623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2572c37-9976-4a9d-83ca-95a646a3206d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.021027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.021615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2572c37-9976-4a9d-83ca-95a646a3206d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.021899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2572c37-9976-4a9d-83ca-95a646a3206d None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.022660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2572c37-9976-4a9d-83ca-95a646a3206d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:07.023028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2572c37-9976-4a9d-83ca-95a646a3206d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.024411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2572c37-9976-4a9d-83ca-95a646a3206d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.037100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 285/567] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:07.043331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2572c37-9976-4a9d-83ca-95a646a3206d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.094223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 283/568] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:07.095205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b76c53-413c-4bbd-b156-16136f78d2a5 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.103818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.147152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2572c37-9976-4a9d-83ca-95a646a3206d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.182324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a6820-a1f4-4961-ba04-d58c0436ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.183161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a6820-a1f4-4961-ba04-d58c0436ae09 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.183452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a6820-a1f4-4961-ba04-d58c0436ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.183735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a6820-a1f4-4961-ba04-d58c0436ae09 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.191956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a6820-a1f4-4961-ba04-d58c0436ae09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.193406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a6820-a1f4-4961-ba04-d58c0436ae09 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.200043 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b76c53-413c-4bbd-b156-16136f78d2a5 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-de1a6820-a1f4-4961-ba04-d58c0436ae09 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:07.211737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:07.212686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 286/569] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:07.219002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a6820-a1f4-4961-ba04-d58c0436ae09 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.246582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bb86e-489b-44f6-9beb-202eeecbb861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.247390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bb86e-489b-44f6-9beb-202eeecbb861 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.247682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bb86e-489b-44f6-9beb-202eeecbb861 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.247963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bb86e-489b-44f6-9beb-202eeecbb861 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.255383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.259839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bb86e-489b-44f6-9beb-202eeecbb861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-dd9bb86e-489b-44f6-9beb-202eeecbb861 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:07.268099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:07.269411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 284/570] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:07.270309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bb86e-489b-44f6-9beb-202eeecbb861 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.330509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a6820-a1f4-4961-ba04-d58c0436ae09 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.350105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.363636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647ee49-5b79-49b0-a32e-6641074aa928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.364434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647ee49-5b79-49b0-a32e-6641074aa928 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.364723 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647ee49-5b79-49b0-a32e-6641074aa928 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.365000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647ee49-5b79-49b0-a32e-6641074aa928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.371547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647ee49-5b79-49b0-a32e-6641074aa928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.372985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647ee49-5b79-49b0-a32e-6641074aa928 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.374780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bb86e-489b-44f6-9beb-202eeecbb861 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-d647ee49-5b79-49b0-a32e-6641074aa928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:07.389711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:07.390675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:07.391573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:07.391573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:07.391573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:07.391573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:07.391573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:07.391573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:07.391573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:07.391573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:07.392421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 287/571] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:07.393360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647ee49-5b79-49b0-a32e-6641074aa928 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.408626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298310c-9c48-4141-8af3-231106af8f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.409410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298310c-9c48-4141-8af3-231106af8f1c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.409692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298310c-9c48-4141-8af3-231106af8f1c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.409980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298310c-9c48-4141-8af3-231106af8f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.420562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298310c-9c48-4141-8af3-231106af8f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.422061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298310c-9c48-4141-8af3-231106af8f1c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-b298310c-9c48-4141-8af3-231106af8f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:07.438934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:07.439920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:07.440827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:07.440827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:07.440827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:07.440827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:07.440827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 285/572] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:07.440827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298310c-9c48-4141-8af3-231106af8f1c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.490643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.492084 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647ee49-5b79-49b0-a32e-6641074aa928 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.525559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3fbb7-b3da-4921-bddb-7dec55830047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.526739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3fbb7-b3da-4921-bddb-7dec55830047 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.527038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3fbb7-b3da-4921-bddb-7dec55830047 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.527322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3fbb7-b3da-4921-bddb-7dec55830047 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.528158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3fbb7-b3da-4921-bddb-7dec55830047 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:07.528625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3fbb7-b3da-4921-bddb-7dec55830047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.529979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3fbb7-b3da-4921-bddb-7dec55830047 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.539125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298310c-9c48-4141-8af3-231106af8f1c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.546560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 288/573] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:07.547836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5612124-f66a-4822-9028-fb0f5e0ddd16 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.548125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5612124-f66a-4822-9028-fb0f5e0ddd16 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.548403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5612124-f66a-4822-9028-fb0f5e0ddd16 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.549767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 289/574] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:07.554271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5612124-f66a-4822-9028-fb0f5e0ddd16 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.574596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0f31-1b10-4991-8181-274cf24c70fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.575276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0f31-1b10-4991-8181-274cf24c70fa None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.575690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0f31-1b10-4991-8181-274cf24c70fa None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.575972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0f31-1b10-4991-8181-274cf24c70fa None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.576726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c0f31-1b10-4991-8181-274cf24c70fa None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:07.577033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c0f31-1b10-4991-8181-274cf24c70fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.578856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c0f31-1b10-4991-8181-274cf24c70fa None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.587312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 286/575] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:07.588094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0f31-1b10-4991-8181-274cf24c70fa None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.596303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.659345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5612124-f66a-4822-9028-fb0f5e0ddd16 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.693075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0f31-1b10-4991-8181-274cf24c70fa None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.693438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50137e3a-d70a-4cd4-b4c6-c89714b42df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.694128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137e3a-d70a-4cd4-b4c6-c89714b42df9 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.694419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137e3a-d70a-4cd4-b4c6-c89714b42df9 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.694699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137e3a-d70a-4cd4-b4c6-c89714b42df9 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.695487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50137e3a-d70a-4cd4-b4c6-c89714b42df9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:07.695803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50137e3a-d70a-4cd4-b4c6-c89714b42df9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.697240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50137e3a-d70a-4cd4-b4c6-c89714b42df9 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.706486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.709615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 290/576] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:07.710456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50137e3a-d70a-4cd4-b4c6-c89714b42df9 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.732858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263ce02-3485-494a-858d-51f97bca37b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.733518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263ce02-3485-494a-858d-51f97bca37b7 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.733807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263ce02-3485-494a-858d-51f97bca37b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.734134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263ce02-3485-494a-858d-51f97bca37b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.734854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263ce02-3485-494a-858d-51f97bca37b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:07.735219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263ce02-3485-494a-858d-51f97bca37b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.736701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263ce02-3485-494a-858d-51f97bca37b7 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.753258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 287/577] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:07.753258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27b14-ff34-4a46-a08a-c2b7d5529092 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.753258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27b14-ff34-4a46-a08a-c2b7d5529092 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.753258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27b14-ff34-4a46-a08a-c2b7d5529092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.768781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-8fa27b14-ff34-4a46-a08a-c2b7d5529092 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:07.770013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8fa27b14-ff34-4a46-a08a-c2b7d5529092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:07.802879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.806463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50137e3a-d70a-4cd4-b4c6-c89714b42df9 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.836542 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 288/578] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:07.837366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa27b14-ff34-4a46-a08a-c2b7d5529092 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.839141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dad3b-70a2-4517-8319-7d105b3ee423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.839941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dad3b-70a2-4517-8319-7d105b3ee423 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.840212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dad3b-70a2-4517-8319-7d105b3ee423 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.840485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dad3b-70a2-4517-8319-7d105b3ee423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.851920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dad3b-70a2-4517-8319-7d105b3ee423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.853477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dad3b-70a2-4517-8319-7d105b3ee423 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-273dad3b-70a2-4517-8319-7d105b3ee423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:07.871459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:07.872352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:07.873221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:07.873221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:07.873221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:07.873221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:07.873221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 291/579] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:07.873496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dad3b-70a2-4517-8319-7d105b3ee423 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.953104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa27b14-ff34-4a46-a08a-c2b7d5529092 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.954638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.972638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dad3b-70a2-4517-8319-7d105b3ee423 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.987463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e2733-eeae-4ee1-8716-374199f53a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.988307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e2733-eeae-4ee1-8716-374199f53a00 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.988781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e2733-eeae-4ee1-8716-374199f53a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.989237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e2733-eeae-4ee1-8716-374199f53a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.000367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e2733-eeae-4ee1-8716-374199f53a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.001897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e2733-eeae-4ee1-8716-374199f53a00 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.005989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183793c-42a2-4fd4-8cce-9d8709a44db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.006869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183793c-42a2-4fd4-8cce-9d8709a44db0 None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.007186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183793c-42a2-4fd4-8cce-9d8709a44db0 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.007464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183793c-42a2-4fd4-8cce-9d8709a44db0 None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/0f46cf6eb4a44a71bda92cb212a8009c/roles/449d76dce6534ca9b28d0a003483d951` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-5a4e2733-eeae-4ee1-8716-374199f53a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:08.019218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:08.020288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:08.021281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:08.021281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:08.021281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:08.021281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:08.021281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 289/580] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:08.021551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e2733-eeae-4ee1-8716-374199f53a00 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.022632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183793c-42a2-4fd4-8cce-9d8709a44db0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=0f46cf6eb4a44a71bda92cb212a8009c, role_id=449d76dce6534ca9b28d0a003483d951)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.024075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183793c-42a2-4fd4-8cce-9d8709a44db0 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.088057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:08.092258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 292/581] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:33:07 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/0f46cf6eb4a44a71bda92cb212a8009c/roles/449d76dce6534ca9b28d0a003483d951 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:33:08.093042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183793c-42a2-4fd4-8cce-9d8709a44db0 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.130419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e2733-eeae-4ee1-8716-374199f53a00 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.169085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc7dc-9a2c-4f64-a3ba-be18570c0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.169894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc7dc-9a2c-4f64-a3ba-be18570c0372 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.170211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc7dc-9a2c-4f64-a3ba-be18570c0372 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.170491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc7dc-9a2c-4f64-a3ba-be18570c0372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.178968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adc7dc-9a2c-4f64-a3ba-be18570c0372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.180471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adc7dc-9a2c-4f64-a3ba-be18570c0372 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-52adc7dc-9a2c-4f64-a3ba-be18570c0372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:08.197342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:08.198547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 290/582] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:08.199443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc7dc-9a2c-4f64-a3ba-be18570c0372 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.211965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183793c-42a2-4fd4-8cce-9d8709a44db0 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.217328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:08.257899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddac1c-6cd7-4faf-9567-16a3ef0a98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.258776 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddac1c-6cd7-4faf-9567-16a3ef0a98ab None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.259099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddac1c-6cd7-4faf-9567-16a3ef0a98ab None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.259339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddac1c-6cd7-4faf-9567-16a3ef0a98ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.270712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddac1c-6cd7-4faf-9567-16a3ef0a98ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-97ddac1c-6cd7-4faf-9567-16a3ef0a98ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:08.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:08.282538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:08.283690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 293/583] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:08.284798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddac1c-6cd7-4faf-9567-16a3ef0a98ab None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.311947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc7dc-9a2c-4f64-a3ba-be18570c0372 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.347931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54038e50-5a92-4448-b503-81e47c9c4953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.348513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54038e50-5a92-4448-b503-81e47c9c4953 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.349063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54038e50-5a92-4448-b503-81e47c9c4953 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.349342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54038e50-5a92-4448-b503-81e47c9c4953 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.350096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54038e50-5a92-4448-b503-81e47c9c4953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:08.350411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54038e50-5a92-4448-b503-81e47c9c4953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.351820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54038e50-5a92-4448-b503-81e47c9c4953 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.357547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:08.369318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 291/584] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:08.369318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54038e50-5a92-4448-b503-81e47c9c4953 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.407766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddac1c-6cd7-4faf-9567-16a3ef0a98ab None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.443734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeaf88-1436-4819-bc87-d5822a84b165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.444406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeaf88-1436-4819-bc87-d5822a84b165 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.444696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeaf88-1436-4819-bc87-d5822a84b165 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.444975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeaf88-1436-4819-bc87-d5822a84b165 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.445710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeaf88-1436-4819-bc87-d5822a84b165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:08.446048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeaf88-1436-4819-bc87-d5822a84b165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.447431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeaf88-1436-4819-bc87-d5822a84b165 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.447900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:08.461631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 294/585] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:08.462715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeaf88-1436-4819-bc87-d5822a84b165 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.478169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54038e50-5a92-4448-b503-81e47c9c4953 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.515765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9a4c3-a763-4989-8692-4b6cac3b701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.516427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9a4c3-a763-4989-8692-4b6cac3b701a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.516716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9a4c3-a763-4989-8692-4b6cac3b701a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.517008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9a4c3-a763-4989-8692-4b6cac3b701a None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.517915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9a4c3-a763-4989-8692-4b6cac3b701a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:08.518153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9a4c3-a763-4989-8692-4b6cac3b701a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.519556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9a4c3-a763-4989-8692-4b6cac3b701a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.536376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 292/586] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:08.536376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9a4c3-a763-4989-8692-4b6cac3b701a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.583293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeaf88-1436-4819-bc87-d5822a84b165 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.611777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:08.619911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901cf3e-5e52-4828-96cc-f1bd8f4463e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.620580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901cf3e-5e52-4828-96cc-f1bd8f4463e6 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.620903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901cf3e-5e52-4828-96cc-f1bd8f4463e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.621188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901cf3e-5e52-4828-96cc-f1bd8f4463e6 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.621955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901cf3e-5e52-4828-96cc-f1bd8f4463e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:08.622284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901cf3e-5e52-4828-96cc-f1bd8f4463e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.623670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901cf3e-5e52-4828-96cc-f1bd8f4463e6 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.631719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 295/587] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:08.632507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901cf3e-5e52-4828-96cc-f1bd8f4463e6 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.654208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9a4c3-a763-4989-8692-4b6cac3b701a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.714262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2b078-060d-4260-be7e-898cbe4486f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.715064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2b078-060d-4260-be7e-898cbe4486f2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.715354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2b078-060d-4260-be7e-898cbe4486f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.715636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2b078-060d-4260-be7e-898cbe4486f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.718037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:08.724681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2b078-060d-4260-be7e-898cbe4486f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.726219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2b078-060d-4260-be7e-898cbe4486f2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-b5a2b078-060d-4260-be7e-898cbe4486f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:08.741093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:08.741987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:08.742875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:08.742875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:08.742875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:08.742875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:08.742875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:08.742875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:08.742875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:08.742875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:08.742875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 293/588] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:08.743348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2b078-060d-4260-be7e-898cbe4486f2 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.786220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901cf3e-5e52-4828-96cc-f1bd8f4463e6 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.821005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9748-0034-4599-b476-16375cb3c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.821801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9748-0034-4599-b476-16375cb3c669 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.822113 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9748-0034-4599-b476-16375cb3c669 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.822385 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9748-0034-4599-b476-16375cb3c669 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.830472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c9748-0034-4599-b476-16375cb3c669 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.831901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c9748-0034-4599-b476-16375cb3c669 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-2f3c9748-0034-4599-b476-16375cb3c669 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:08.846742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:08.847676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 296/589] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:08.848945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9748-0034-4599-b476-16375cb3c669 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.855742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2b078-060d-4260-be7e-898cbe4486f2 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.897367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:08.897767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457e57b-6fbf-44fd-afad-0107c0d29579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.898400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457e57b-6fbf-44fd-afad-0107c0d29579 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.898687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457e57b-6fbf-44fd-afad-0107c0d29579 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.899047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457e57b-6fbf-44fd-afad-0107c0d29579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.899794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457e57b-6fbf-44fd-afad-0107c0d29579 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=f93427bde8154d509bc67675b03903db) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:08.900107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457e57b-6fbf-44fd-afad-0107c0d29579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.902268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457e57b-6fbf-44fd-afad-0107c0d29579 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.908047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 294/590] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/role_assignments?user.id=f93427bde8154d509bc67675b03903db&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:08.908716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457e57b-6fbf-44fd-afad-0107c0d29579 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.969773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9748-0034-4599-b476-16375cb3c669 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.989988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:09.012821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3084c1-df36-4c36-9feb-f7382f534fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.013630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3084c1-df36-4c36-9feb-f7382f534fb6 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.013915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3084c1-df36-4c36-9feb-f7382f534fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.014238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3084c1-df36-4c36-9feb-f7382f534fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.026788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3084c1-df36-4c36-9feb-f7382f534fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.028271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3084c1-df36-4c36-9feb-f7382f534fb6 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:09.045809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457e57b-6fbf-44fd-afad-0107c0d29579 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-1c3084c1-df36-4c36-9feb-f7382f534fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:09.048751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:09.049629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:09.050555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:09.050555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:09.050555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:09.050555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:09.050555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 297/591] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:09.050861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3084c1-df36-4c36-9feb-f7382f534fb6 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:09.094352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251c2f7-65e5-44d8-9178-4b3157b31f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.095398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251c2f7-65e5-44d8-9178-4b3157b31f70 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.096039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251c2f7-65e5-44d8-9178-4b3157b31f70 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.096530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251c2f7-65e5-44d8-9178-4b3157b31f70 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.098376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251c2f7-65e5-44d8-9178-4b3157b31f70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:09.099165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251c2f7-65e5-44d8-9178-4b3157b31f70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.100825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251c2f7-65e5-44d8-9178-4b3157b31f70 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:09.116164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 295/592] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:09.117261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251c2f7-65e5-44d8-9178-4b3157b31f70 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:09.171884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:09.178536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3084c1-df36-4c36-9feb-f7382f534fb6 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:09.216739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9354d-4b41-4ed7-9353-a2e31e932f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.217418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9354d-4b41-4ed7-9353-a2e31e932f53 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.217706 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9354d-4b41-4ed7-9353-a2e31e932f53 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.218012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9354d-4b41-4ed7-9353-a2e31e932f53 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.218862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9354d-4b41-4ed7-9353-a2e31e932f53 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:09.219173 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9354d-4b41-4ed7-9353-a2e31e932f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.220608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9354d-4b41-4ed7-9353-a2e31e932f53 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:09.239333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 298/593] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 10:33:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:09.240285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9354d-4b41-4ed7-9353-a2e31e932f53 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:09.251950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251c2f7-65e5-44d8-9178-4b3157b31f70 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:09.271910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:09.296131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb57d50-e239-4a3c-89b8-7425bc37b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.297190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb57d50-e239-4a3c-89b8-7425bc37b307 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.297679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb57d50-e239-4a3c-89b8-7425bc37b307 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.298133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb57d50-e239-4a3c-89b8-7425bc37b307 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.299164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb57d50-e239-4a3c-89b8-7425bc37b307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:09.299723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb57d50-e239-4a3c-89b8-7425bc37b307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.301418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb57d50-e239-4a3c-89b8-7425bc37b307 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:09.318203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 296/594] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:09.319308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb57d50-e239-4a3c-89b8-7425bc37b307 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:09.352523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9354d-4b41-4ed7-9353-a2e31e932f53 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:09.393025 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece8dd9-a38c-4961-83f4-fb8ed01bfe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.394056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece8dd9-a38c-4961-83f4-fb8ed01bfe5e None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.394344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece8dd9-a38c-4961-83f4-fb8ed01bfe5e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.394626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece8dd9-a38c-4961-83f4-fb8ed01bfe5e None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/9e839d1074f24a5ba7a552472e167067/roles/449d76dce6534ca9b28d0a003483d951` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.409289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece8dd9-a38c-4961-83f4-fb8ed01bfe5e None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=9e839d1074f24a5ba7a552472e167067, role_id=449d76dce6534ca9b28d0a003483d951)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.410774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece8dd9-a38c-4961-83f4-fb8ed01bfe5e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:09.447819 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb57d50-e239-4a3c-89b8-7425bc37b307 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:09.485864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be716249-bce4-44f0-90fb-e39c41b151df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.486695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be716249-bce4-44f0-90fb-e39c41b151df None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.486980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be716249-bce4-44f0-90fb-e39c41b151df None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.487262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be716249-bce4-44f0-90fb-e39c41b151df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.501982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be716249-bce4-44f0-90fb-e39c41b151df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.501982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be716249-bce4-44f0-90fb-e39c41b151df None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:09.502578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 299/595] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:33:09 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/9e839d1074f24a5ba7a552472e167067/roles/449d76dce6534ca9b28d0a003483d951 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:33:09.503688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece8dd9-a38c-4961-83f4-fb8ed01bfe5e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:09.513022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-be716249-bce4-44f0-90fb-e39c41b151df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:09.521596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:09.522612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:09.523512 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:09.523512 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:09.523512 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:09.523512 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:09.523512 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 297/596] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:09.529418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be716249-bce4-44f0-90fb-e39c41b151df None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:09.565957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:09.649232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be716249-bce4-44f0-90fb-e39c41b151df None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:09.697581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2b4b2-683f-44ec-98c5-58cd1aeec398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.698864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2b4b2-683f-44ec-98c5-58cd1aeec398 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.699096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2b4b2-683f-44ec-98c5-58cd1aeec398 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.699377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2b4b2-683f-44ec-98c5-58cd1aeec398 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.700116 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2b4b2-683f-44ec-98c5-58cd1aeec398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:09.700426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2b4b2-683f-44ec-98c5-58cd1aeec398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.702012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2b4b2-683f-44ec-98c5-58cd1aeec398 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:09.717113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 298/597] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:09.722917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2b4b2-683f-44ec-98c5-58cd1aeec398 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:09.730366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece8dd9-a38c-4961-83f4-fb8ed01bfe5e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:09.765854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5fcd0-2e73-4d21-854b-91732229eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.766707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5fcd0-2e73-4d21-854b-91732229eedf None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.766998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5fcd0-2e73-4d21-854b-91732229eedf None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.767281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5fcd0-2e73-4d21-854b-91732229eedf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.774925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5fcd0-2e73-4d21-854b-91732229eedf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.776947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5fcd0-2e73-4d21-854b-91732229eedf None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-bea5fcd0-2e73-4d21-854b-91732229eedf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:09.791923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:09.792911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:09.793843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 300/598] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:09.798820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5fcd0-2e73-4d21-854b-91732229eedf None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:09.825898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:09.836905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2b4b2-683f-44ec-98c5-58cd1aeec398 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:09.868115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:09.887273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fad35-e34a-46bd-aa8f-9de4bafaa88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.888885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fad35-e34a-46bd-aa8f-9de4bafaa88f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.889174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fad35-e34a-46bd-aa8f-9de4bafaa88f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.889453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fad35-e34a-46bd-aa8f-9de4bafaa88f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.897166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fad35-e34a-46bd-aa8f-9de4bafaa88f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.899265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fad35-e34a-46bd-aa8f-9de4bafaa88f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-e33fad35-e34a-46bd-aa8f-9de4bafaa88f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:09.922324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:09.923272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:09.924158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:09.924158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:09.924158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:09.924158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:09.924158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:09.924158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:09.924158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:09.924158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:09.924158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 299/599] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:09.926659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5fcd0-2e73-4d21-854b-91732229eedf None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:09.930575 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fad35-e34a-46bd-aa8f-9de4bafaa88f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:09.979898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f37de-551f-43bb-abc5-5fe0cf0f93b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:09.980528 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f37de-551f-43bb-abc5-5fe0cf0f93b5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:09.980822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f37de-551f-43bb-abc5-5fe0cf0f93b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:09.981112 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f37de-551f-43bb-abc5-5fe0cf0f93b5 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:09.981994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f37de-551f-43bb-abc5-5fe0cf0f93b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:09.982322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f37de-551f-43bb-abc5-5fe0cf0f93b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:09.985075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f37de-551f-43bb-abc5-5fe0cf0f93b5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:10.009075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 301/600] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jun 30 10:33:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:10.015126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f37de-551f-43bb-abc5-5fe0cf0f93b5 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:10.054572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fad35-e34a-46bd-aa8f-9de4bafaa88f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:10.092416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e9439-380e-4cae-a3fd-1cac7cf67ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:10.093472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e9439-380e-4cae-a3fd-1cac7cf67ad8 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.094017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e9439-380e-4cae-a3fd-1cac7cf67ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.094506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e9439-380e-4cae-a3fd-1cac7cf67ad8 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.095513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e9439-380e-4cae-a3fd-1cac7cf67ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:10.096033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e9439-380e-4cae-a3fd-1cac7cf67ad8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:10.097700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e9439-380e-4cae-a3fd-1cac7cf67ad8 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:10.111221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 300/601] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:10.121982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e9439-380e-4cae-a3fd-1cac7cf67ad8 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:10.135307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f37de-551f-43bb-abc5-5fe0cf0f93b5 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:10.141486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:10.164391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:10.182875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e497d-f807-4fef-8f0c-ddf9b314b686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:10.183675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e497d-f807-4fef-8f0c-ddf9b314b686 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.183958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e497d-f807-4fef-8f0c-ddf9b314b686 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.184236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e497d-f807-4fef-8f0c-ddf9b314b686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.194621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e497d-f807-4fef-8f0c-ddf9b314b686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:10.196172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e497d-f807-4fef-8f0c-ddf9b314b686 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-1a3e497d-f807-4fef-8f0c-ddf9b314b686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:10.214406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:10.215341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:10.216238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:10.216238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:10.216238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:10.216238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:10.218608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 302/602] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:10.221293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941cdf5-e873-486d-81b9-19403e790f2c None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.221929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941cdf5-e873-486d-81b9-19403e790f2c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.222239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941cdf5-e873-486d-81b9-19403e790f2c None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.224974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 303/603] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:10.224974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941cdf5-e873-486d-81b9-19403e790f2c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:10.269395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e9439-380e-4cae-a3fd-1cac7cf67ad8 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:10.317620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56d5e-1923-4f79-978f-c0a21340c05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:10.318566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56d5e-1923-4f79-978f-c0a21340c05d None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.319009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56d5e-1923-4f79-978f-c0a21340c05d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.319297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56d5e-1923-4f79-978f-c0a21340c05d None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/19fd3da30bdb477e99dbbc2f7075f161/roles/449d76dce6534ca9b28d0a003483d951` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.340354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f56d5e-1923-4f79-978f-c0a21340c05d None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=19fd3da30bdb477e99dbbc2f7075f161, role_id=449d76dce6534ca9b28d0a003483d951)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:10.342109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f56d5e-1923-4f79-978f-c0a21340c05d None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:10.361864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941cdf5-e873-486d-81b9-19403e790f2c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:10.398675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602d984-2184-4276-9f1c-d706efce5a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:10.399420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d984-2184-4276-9f1c-d706efce5a4f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.399717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d984-2184-4276-9f1c-d706efce5a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.399995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d984-2184-4276-9f1c-d706efce5a4f None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.400724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602d984-2184-4276-9f1c-d706efce5a4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:10.401069 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602d984-2184-4276-9f1c-d706efce5a4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:10.402485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602d984-2184-4276-9f1c-d706efce5a4f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:10.419293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 304/604] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:10.419293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f166a1a-1d1d-4da2-83f6-97ee56e091d7 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.419293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f166a1a-1d1d-4da2-83f6-97ee56e091d7 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.419293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f166a1a-1d1d-4da2-83f6-97ee56e091d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.435259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3f166a1a-1d1d-4da2-83f6-97ee56e091d7 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:10.436456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3f166a1a-1d1d-4da2-83f6-97ee56e091d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:10.464208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 301/605] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:33:10 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/19fd3da30bdb477e99dbbc2f7075f161/roles/449d76dce6534ca9b28d0a003483d951 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:33:10.465200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56d5e-1923-4f79-978f-c0a21340c05d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:10.481483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:10.577403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 305/606] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:10.589495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:10.603423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f166a1a-1d1d-4da2-83f6-97ee56e091d7 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:10.652925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56d5e-1923-4f79-978f-c0a21340c05d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:10.699133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628008-e905-4034-bba3-689a38b061c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:10.699934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628008-e905-4034-bba3-689a38b061c4 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.700220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628008-e905-4034-bba3-689a38b061c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.700498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628008-e905-4034-bba3-689a38b061c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.708899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78628008-e905-4034-bba3-689a38b061c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:10.710392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78628008-e905-4034-bba3-689a38b061c4 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-78628008-e905-4034-bba3-689a38b061c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:10.725904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:10.726859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:10.728077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:10.728077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:10.728077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:10.728077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:10.728077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:10.728077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:10.728077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:10.728077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:10.728077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 302/607] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:10.734878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628008-e905-4034-bba3-689a38b061c4 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:10.756337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f166a1a-1d1d-4da2-83f6-97ee56e091d7 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:10.834587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb1fd-01b6-4135-9627-e90090a6b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:10.835315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb1fd-01b6-4135-9627-e90090a6b00b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.835598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb1fd-01b6-4135-9627-e90090a6b00b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.835872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb1fd-01b6-4135-9627-e90090a6b00b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.855277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628008-e905-4034-bba3-689a38b061c4 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:10.863874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb1fd-01b6-4135-9627-e90090a6b00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-9b4cb1fd-01b6-4135-9627-e90090a6b00b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:10.872121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:10.873038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:10.874850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 306/608] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:10.879946 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb1fd-01b6-4135-9627-e90090a6b00b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:10.893454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:10.922576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ece688-b1f0-4b8f-9725-9504113bf424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:10.923561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ece688-b1f0-4b8f-9725-9504113bf424 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.924022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ece688-b1f0-4b8f-9725-9504113bf424 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.924485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ece688-b1f0-4b8f-9725-9504113bf424 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.925460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ece688-b1f0-4b8f-9725-9504113bf424 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:10.925966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ece688-b1f0-4b8f-9725-9504113bf424 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:10.927597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ece688-b1f0-4b8f-9725-9504113bf424 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:10.933111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:10.948329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 303/609] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:10.958622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ece688-b1f0-4b8f-9725-9504113bf424 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:11.067351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb1fd-01b6-4135-9627-e90090a6b00b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:11.128472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ece688-b1f0-4b8f-9725-9504113bf424 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:11.132370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa6fe9-e849-404e-aace-46c192354c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:11.133040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa6fe9-e849-404e-aace-46c192354c4f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:11.133323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa6fe9-e849-404e-aace-46c192354c4f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:11.133599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa6fe9-e849-404e-aace-46c192354c4f None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:11.134380 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa6fe9-e849-404e-aace-46c192354c4f None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:11.134746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa6fe9-e849-404e-aace-46c192354c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:11.136636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa6fe9-e849-404e-aace-46c192354c4f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:11.152200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 307/610] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:11.158824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa6fe9-e849-404e-aace-46c192354c4f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:11.197153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fee529-64ca-48fa-b0b2-e2a4e86e2582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:11.198604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fee529-64ca-48fa-b0b2-e2a4e86e2582 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:11.198883 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fee529-64ca-48fa-b0b2-e2a4e86e2582 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:11.199154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fee529-64ca-48fa-b0b2-e2a4e86e2582 None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/719afb6dcb154119beb18d2f1974fe2e/roles/449d76dce6534ca9b28d0a003483d951` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:11.228504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fee529-64ca-48fa-b0b2-e2a4e86e2582 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=719afb6dcb154119beb18d2f1974fe2e, role_id=449d76dce6534ca9b28d0a003483d951)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:11.230012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fee529-64ca-48fa-b0b2-e2a4e86e2582 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:11.277151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:11.293230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa6fe9-e849-404e-aace-46c192354c4f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:11.321123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 304/611] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:33:10 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/719afb6dcb154119beb18d2f1974fe2e/roles/449d76dce6534ca9b28d0a003483d951 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:33:11.342428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49a003-4083-4f73-9b30-c2dc68d4b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:11.343234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49a003-4083-4f73-9b30-c2dc68d4b36d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:11.343519 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49a003-4083-4f73-9b30-c2dc68d4b36d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:11.343795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49a003-4083-4f73-9b30-c2dc68d4b36d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:11.359816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49a003-4083-4f73-9b30-c2dc68d4b36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:11.361393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49a003-4083-4f73-9b30-c2dc68d4b36d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:11.362885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15ca50-be40-49aa-a37d-3c6d51132d76 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:11.363175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15ca50-be40-49aa-a37d-3c6d51132d76 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:11.363459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15ca50-be40-49aa-a37d-3c6d51132d76 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:11.365095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 305/612] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:11.371172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4d93e-d10a-45a9-8d49-b980fb8378cb None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:11.371468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4d93e-d10a-45a9-8d49-b980fb8378cb None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:11.371754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4d93e-d10a-45a9-8d49-b980fb8378cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-3c49a003-4083-4f73-9b30-c2dc68d4b36d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:11.383275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:11.384365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:11.386143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:11.386143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:11.386143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:11.386143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:11.388214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 308/613] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:11.401073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49a003-4083-4f73-9b30-c2dc68d4b36d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:11.408906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-fcc4d93e-d10a-45a9-8d49-b980fb8378cb None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:11.410174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fcc4d93e-d10a-45a9-8d49-b980fb8378cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:11.464163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:11.544756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 306/614] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:33:11.577932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4d93e-d10a-45a9-8d49-b980fb8378cb None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:11.582721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49a003-4083-4f73-9b30-c2dc68d4b36d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:11.624079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57f23c-6fca-45eb-9555-4b3c410abba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:11.624888 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57f23c-6fca-45eb-9555-4b3c410abba4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:11.625184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57f23c-6fca-45eb-9555-4b3c410abba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:11.625468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57f23c-6fca-45eb-9555-4b3c410abba4 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:11.626235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57f23c-6fca-45eb-9555-4b3c410abba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:11.626554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57f23c-6fca-45eb-9555-4b3c410abba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:11.629396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57f23c-6fca-45eb-9555-4b3c410abba4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:11.631698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:11.648626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 309/615] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:11.649278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57f23c-6fca-45eb-9555-4b3c410abba4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:11.751488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57f23c-6fca-45eb-9555-4b3c410abba4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:11.761840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4d93e-d10a-45a9-8d49-b980fb8378cb None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:11.786414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129704c-ae95-4962-9a94-55547c2ce174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:11.787211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129704c-ae95-4962-9a94-55547c2ce174 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:11.787501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129704c-ae95-4962-9a94-55547c2ce174 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:11.787785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129704c-ae95-4962-9a94-55547c2ce174 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:11.795791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129704c-ae95-4962-9a94-55547c2ce174 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:11.797250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129704c-ae95-4962-9a94-55547c2ce174 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-2129704c-ae95-4962-9a94-55547c2ce174 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:11.818761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:11.819742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:11.820719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:11.821269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf81eb9-e124-47e8-b737-5df305ded724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:11.821870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf81eb9-e124-47e8-b737-5df305ded724 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:11.821870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf81eb9-e124-47e8-b737-5df305ded724 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:11.822059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf81eb9-e124-47e8-b737-5df305ded724 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:11.828496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 310/616] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 10:33:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:11.829355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129704c-ae95-4962-9a94-55547c2ce174 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:11.847470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf81eb9-e124-47e8-b737-5df305ded724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-dbf81eb9-e124-47e8-b737-5df305ded724 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:11.856126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:11.857085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:11.857924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:11.859471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 307/617] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:11.868516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf81eb9-e124-47e8-b737-5df305ded724 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:11.925402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:11.946151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:11.992039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129704c-ae95-4962-9a94-55547c2ce174 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.029805 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30bd59-2056-4357-90ef-eda8ad67f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.030613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30bd59-2056-4357-90ef-eda8ad67f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.030905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30bd59-2056-4357-90ef-eda8ad67f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.031189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30bd59-2056-4357-90ef-eda8ad67f5e1 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.032038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30bd59-2056-4357-90ef-eda8ad67f5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:12.032432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30bd59-2056-4357-90ef-eda8ad67f5e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.032854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf81eb9-e124-47e8-b737-5df305ded724 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.033780 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30bd59-2056-4357-90ef-eda8ad67f5e1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.058050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 311/618] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 10:33:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:12.059532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685225c-59cf-444f-a684-528af4038c20 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.059832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685225c-59cf-444f-a684-528af4038c20 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.060115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685225c-59cf-444f-a684-528af4038c20 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.061861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 312/619] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:12.062727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685225c-59cf-444f-a684-528af4038c20 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.079039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca8f80-5b56-4395-9153-390a679ba0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.079711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca8f80-5b56-4395-9153-390a679ba0e7 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.079996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca8f80-5b56-4395-9153-390a679ba0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.080525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca8f80-5b56-4395-9153-390a679ba0e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.081747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca8f80-5b56-4395-9153-390a679ba0e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:12.082087 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca8f80-5b56-4395-9153-390a679ba0e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.084007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca8f80-5b56-4395-9153-390a679ba0e7 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.095921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 308/620] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:12.097472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe021e-6065-41c3-8316-72a052b9fdad None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.097762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe021e-6065-41c3-8316-72a052b9fdad None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.098090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe021e-6065-41c3-8316-72a052b9fdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.118585 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-aefe021e-6065-41c3-8316-72a052b9fdad None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:12.120994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-aefe021e-6065-41c3-8316-72a052b9fdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:12.178047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685225c-59cf-444f-a684-528af4038c20 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.193739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:12.218101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 309/621] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:12.218101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe021e-6065-41c3-8316-72a052b9fdad None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.231346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50461cf-1c77-4743-ac66-536e800f0d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.232002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50461cf-1c77-4743-ac66-536e800f0d85 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.232292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50461cf-1c77-4743-ac66-536e800f0d85 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.232573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50461cf-1c77-4743-ac66-536e800f0d85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.245310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:12.308997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50461cf-1c77-4743-ac66-536e800f0d85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.310567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50461cf-1c77-4743-ac66-536e800f0d85 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.335800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe021e-6065-41c3-8316-72a052b9fdad None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.372844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98201894-80af-493e-94cf-67d6982b37d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.374042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98201894-80af-493e-94cf-67d6982b37d3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.374548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98201894-80af-493e-94cf-67d6982b37d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.375024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98201894-80af-493e-94cf-67d6982b37d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.385865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98201894-80af-493e-94cf-67d6982b37d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.387591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98201894-80af-493e-94cf-67d6982b37d3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-98201894-80af-493e-94cf-67d6982b37d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:12.406789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:12.407698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:12.408600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:12.408600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:12.408600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:12.408600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:12.410927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 310/622] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:12.411896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98201894-80af-493e-94cf-67d6982b37d3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.421592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 313/623] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:12.426752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50461cf-1c77-4743-ac66-536e800f0d85 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.442469 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:12.483302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:12.522764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98201894-80af-493e-94cf-67d6982b37d3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.532355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50461cf-1c77-4743-ac66-536e800f0d85 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.559608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee807081-6831-4744-8fd1-6bb7f5227588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.560772 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807081-6831-4744-8fd1-6bb7f5227588 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.561254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807081-6831-4744-8fd1-6bb7f5227588 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.561724 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807081-6831-4744-8fd1-6bb7f5227588 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.568239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a55e1-eedd-47e6-8a30-fea99e06eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.568913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a55e1-eedd-47e6-8a30-fea99e06eba1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.569201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a55e1-eedd-47e6-8a30-fea99e06eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.569485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a55e1-eedd-47e6-8a30-fea99e06eba1 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.570364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a55e1-eedd-47e6-8a30-fea99e06eba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:12.570684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a55e1-eedd-47e6-8a30-fea99e06eba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.572076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a55e1-eedd-47e6-8a30-fea99e06eba1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.575037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee807081-6831-4744-8fd1-6bb7f5227588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-ee807081-6831-4744-8fd1-6bb7f5227588 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:12.582919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:12.583815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:12.584640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:12.592272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 314/625] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:12.592272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a55e1-eedd-47e6-8a30-fea99e06eba1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.592662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 311/625] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:12.593608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee807081-6831-4744-8fd1-6bb7f5227588 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.674390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:12.701403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a55e1-eedd-47e6-8a30-fea99e06eba1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.702201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee807081-6831-4744-8fd1-6bb7f5227588 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.727877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:12.739017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0ccf4-c613-4c54-81a5-5d4dc3a15366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.739964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0ccf4-c613-4c54-81a5-5d4dc3a15366 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.740124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b1ca1-0617-4d35-86fc-d9e5a639a6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.740443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0ccf4-c613-4c54-81a5-5d4dc3a15366 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.740839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0ccf4-c613-4c54-81a5-5d4dc3a15366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.741393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1ca1-0617-4d35-86fc-d9e5a639a6a6 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.741856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1ca1-0617-4d35-86fc-d9e5a639a6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.742360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1ca1-0617-4d35-86fc-d9e5a639a6a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.750450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b1ca1-0617-4d35-86fc-d9e5a639a6a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.752148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b1ca1-0617-4d35-86fc-d9e5a639a6a6 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.752608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0ccf4-c613-4c54-81a5-5d4dc3a15366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.754080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0ccf4-c613-4c54-81a5-5d4dc3a15366 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-758b1ca1-0617-4d35-86fc-d9e5a639a6a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:12.768516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:12.769464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:12.770427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-63e0ccf4-c613-4c54-81a5-5d4dc3a15366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:12.772278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:12.773114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:12.774024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:12.774024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:12.774024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:12.774024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:12.775390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 312/627] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:12.776936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b1ca1-0617-4d35-86fc-d9e5a639a6a6 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.778019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 315/627] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:12.782452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0ccf4-c613-4c54-81a5-5d4dc3a15366 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.908115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0ccf4-c613-4c54-81a5-5d4dc3a15366 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.913758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b1ca1-0617-4d35-86fc-d9e5a639a6a6 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.934746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:12.943329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af99d-9ef2-4a38-9137-fd40409b7c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.943992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af99d-9ef2-4a38-9137-fd40409b7c11 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.944284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af99d-9ef2-4a38-9137-fd40409b7c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.944569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af99d-9ef2-4a38-9137-fd40409b7c11 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.945294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5af99d-9ef2-4a38-9137-fd40409b7c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:12.945608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5af99d-9ef2-4a38-9137-fd40409b7c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.947011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5af99d-9ef2-4a38-9137-fd40409b7c11 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.950690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d020ff8-18a6-459d-8ab4-a868609939cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.951352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d020ff8-18a6-459d-8ab4-a868609939cb None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.956131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d020ff8-18a6-459d-8ab4-a868609939cb None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.956131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d020ff8-18a6-459d-8ab4-a868609939cb None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.956131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d020ff8-18a6-459d-8ab4-a868609939cb None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:12.956131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d020ff8-18a6-459d-8ab4-a868609939cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.956131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d020ff8-18a6-459d-8ab4-a868609939cb None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.964278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 316/628] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:12.964278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af99d-9ef2-4a38-9137-fd40409b7c11 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.967913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 313/629] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:12.972228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd626b-d6bc-4321-a1e6-d08375abdab7 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.972228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd626b-d6bc-4321-a1e6-d08375abdab7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.972228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd626b-d6bc-4321-a1e6-d08375abdab7 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.972228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 314/630] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:12.972228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd626b-d6bc-4321-a1e6-d08375abdab7 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.021288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:13.080638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af99d-9ef2-4a38-9137-fd40409b7c11 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.082298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd626b-d6bc-4321-a1e6-d08375abdab7 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.117461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55385ffd-a3a1-4a22-bc66-05275b0514ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.118160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55385ffd-a3a1-4a22-bc66-05275b0514ad None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.118446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55385ffd-a3a1-4a22-bc66-05275b0514ad None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.118722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55385ffd-a3a1-4a22-bc66-05275b0514ad None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.120075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55385ffd-a3a1-4a22-bc66-05275b0514ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:13.120178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1300bb-576d-4a93-a457-b0b9dab4e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.120388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55385ffd-a3a1-4a22-bc66-05275b0514ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:13.120866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1300bb-576d-4a93-a457-b0b9dab4e595 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.121157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1300bb-576d-4a93-a457-b0b9dab4e595 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.121441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1300bb-576d-4a93-a457-b0b9dab4e595 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.121812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55385ffd-a3a1-4a22-bc66-05275b0514ad None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:13.128533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1300bb-576d-4a93-a457-b0b9dab4e595 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:13.129987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1300bb-576d-4a93-a457-b0b9dab4e595 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:13.145094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 317/631] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:13.145094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55385ffd-a3a1-4a22-bc66-05275b0514ad None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1c1300bb-576d-4a93-a457-b0b9dab4e595 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:13.145650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:13.146713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:13.147607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:13.147607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:13.147607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:13.147607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:13.147607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:13.147607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:13.147607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:13.147607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:13.147607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 315/632] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:13.148473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654aefc-0d27-44fe-b53f-6be36c5cb05b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.148576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654aefc-0d27-44fe-b53f-6be36c5cb05b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.148853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654aefc-0d27-44fe-b53f-6be36c5cb05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.166450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7654aefc-0d27-44fe-b53f-6be36c5cb05b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:13.167625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7654aefc-0d27-44fe-b53f-6be36c5cb05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:13.199262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:13.246040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 316/633] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:13.246040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654aefc-0d27-44fe-b53f-6be36c5cb05b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.265103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55385ffd-a3a1-4a22-bc66-05275b0514ad None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.287120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:13.302126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e9fa2-8f82-41ae-9e37-2060fec391d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.305181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9fa2-8f82-41ae-9e37-2060fec391d8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.305181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9fa2-8f82-41ae-9e37-2060fec391d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.305181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9fa2-8f82-41ae-9e37-2060fec391d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.315471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e9fa2-8f82-41ae-9e37-2060fec391d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:13.316914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e9fa2-8f82-41ae-9e37-2060fec391d8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-582e9fa2-8f82-41ae-9e37-2060fec391d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:13.334231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:13.335166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:13.336060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:13.336060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:13.336060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:13.336060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:13.336060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 318/634] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:13.336333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e9fa2-8f82-41ae-9e37-2060fec391d8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.359318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654aefc-0d27-44fe-b53f-6be36c5cb05b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.395381 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8f2fa-e5e4-44d3-85b9-a4190aa611b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.396153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8f2fa-e5e4-44d3-85b9-a4190aa611b6 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.396439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8f2fa-e5e4-44d3-85b9-a4190aa611b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.396714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8f2fa-e5e4-44d3-85b9-a4190aa611b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.406956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8f2fa-e5e4-44d3-85b9-a4190aa611b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:13.408399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8f2fa-e5e4-44d3-85b9-a4190aa611b6 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-3ac8f2fa-e5e4-44d3-85b9-a4190aa611b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:13.426428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:13.427389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:13.428292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:13.428292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:13.428292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:13.428292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:13.428292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 317/635] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:13.429012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8f2fa-e5e4-44d3-85b9-a4190aa611b6 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.442747 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:13.450953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e9fa2-8f82-41ae-9e37-2060fec391d8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.488210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444e207-3f7d-49c1-8535-6e9204bc0043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.488870 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444e207-3f7d-49c1-8535-6e9204bc0043 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.489156 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444e207-3f7d-49c1-8535-6e9204bc0043 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.489439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444e207-3f7d-49c1-8535-6e9204bc0043 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.490249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444e207-3f7d-49c1-8535-6e9204bc0043 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:13.490561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444e207-3f7d-49c1-8535-6e9204bc0043 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:13.491986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444e207-3f7d-49c1-8535-6e9204bc0043 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:13.505745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 319/636] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:13.506063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444e207-3f7d-49c1-8535-6e9204bc0043 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.529474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:13.541873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8f2fa-e5e4-44d3-85b9-a4190aa611b6 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.578783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af9f23-21ff-4b69-b5a7-7969b1821c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.579583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af9f23-21ff-4b69-b5a7-7969b1821c78 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.579873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af9f23-21ff-4b69-b5a7-7969b1821c78 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.580154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af9f23-21ff-4b69-b5a7-7969b1821c78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.591932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af9f23-21ff-4b69-b5a7-7969b1821c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-94af9f23-21ff-4b69-b5a7-7969b1821c78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:13.600950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:13.602159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:13.603199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 318/637] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:13.605413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af9f23-21ff-4b69-b5a7-7969b1821c78 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.611353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444e207-3f7d-49c1-8535-6e9204bc0043 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.644592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b056e-ee9e-40c1-94f5-72c452b8a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.645256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b056e-ee9e-40c1-94f5-72c452b8a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.645541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b056e-ee9e-40c1-94f5-72c452b8a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.645820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b056e-ee9e-40c1-94f5-72c452b8a7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.646579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b056e-ee9e-40c1-94f5-72c452b8a7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:13.646891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b056e-ee9e-40c1-94f5-72c452b8a7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:13.648251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b056e-ee9e-40c1-94f5-72c452b8a7f6 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:13.659740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 320/638] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:13.660511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b056e-ee9e-40c1-94f5-72c452b8a7f6 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.679228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:13.710614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af9f23-21ff-4b69-b5a7-7969b1821c78 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.744314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82634fe6-4972-4cef-8e1b-5b084530e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.744972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82634fe6-4972-4cef-8e1b-5b084530e694 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.745257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82634fe6-4972-4cef-8e1b-5b084530e694 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.745536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82634fe6-4972-4cef-8e1b-5b084530e694 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.746296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82634fe6-4972-4cef-8e1b-5b084530e694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:13.746611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82634fe6-4972-4cef-8e1b-5b084530e694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:13.747995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82634fe6-4972-4cef-8e1b-5b084530e694 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:13.759144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b056e-ee9e-40c1-94f5-72c452b8a7f6 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.760130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 319/639] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:13.761359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1955d-68e5-4c6d-8b98-1545ffd151c7 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.761651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1955d-68e5-4c6d-8b98-1545ffd151c7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.761951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1955d-68e5-4c6d-8b98-1545ffd151c7 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.763196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 320/640] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:13.763900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1955d-68e5-4c6d-8b98-1545ffd151c7 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.775058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:13.797807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701059c-ec7d-4de9-8283-d03723a77bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.798493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701059c-ec7d-4de9-8283-d03723a77bf5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.798784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701059c-ec7d-4de9-8283-d03723a77bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.799065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701059c-ec7d-4de9-8283-d03723a77bf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.799902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701059c-ec7d-4de9-8283-d03723a77bf5 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=0f46cf6eb4a44a71bda92cb212a8009c) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:13.800219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701059c-ec7d-4de9-8283-d03723a77bf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:13.801654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701059c-ec7d-4de9-8283-d03723a77bf5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:13.807637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 321/641] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/role_assignments?user.id=0f46cf6eb4a44a71bda92cb212a8009c&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:13.808241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701059c-ec7d-4de9-8283-d03723a77bf5 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.876513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1955d-68e5-4c6d-8b98-1545ffd151c7 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.915935 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c079-874c-458f-9a64-746daf14e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.917273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c079-874c-458f-9a64-746daf14e191 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.917562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c079-874c-458f-9a64-746daf14e191 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.917839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c079-874c-458f-9a64-746daf14e191 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:13.918645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34c079-874c-458f-9a64-746daf14e191 None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:13.918958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34c079-874c-458f-9a64-746daf14e191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:13.920369 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34c079-874c-458f-9a64-746daf14e191 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:13.925277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:13.930221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 321/642] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:13.931351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c079-874c-458f-9a64-746daf14e191 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:13.951230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701059c-ec7d-4de9-8283-d03723a77bf5 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:13.992517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9362-f072-4fdb-9d61-00e6215f2946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:13.993349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9362-f072-4fdb-9d61-00e6215f2946 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:13.993640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9362-f072-4fdb-9d61-00e6215f2946 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:13.993918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9362-f072-4fdb-9d61-00e6215f2946 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.002034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d9362-f072-4fdb-9d61-00e6215f2946 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.003488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d9362-f072-4fdb-9d61-00e6215f2946 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.012681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-ed1d9362-f072-4fdb-9d61-00e6215f2946 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:14.019702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:14.029590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 322/643] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fc5a0-8090-42b2-8bac-fc7f0b438874 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.030850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fc5a0-8090-42b2-8bac-fc7f0b438874 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.031737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fc5a0-8090-42b2-8bac-fc7f0b438874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.044999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ad7fc5a0-8090-42b2-8bac-fc7f0b438874 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:14.046268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ad7fc5a0-8090-42b2-8bac-fc7f0b438874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:14.050248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c079-874c-458f-9a64-746daf14e191 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.086364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba07265-a7d6-4d7e-b477-5904c49ffab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.087165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba07265-a7d6-4d7e-b477-5904c49ffab1 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.087453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba07265-a7d6-4d7e-b477-5904c49ffab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.087734 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba07265-a7d6-4d7e-b477-5904c49ffab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.095537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba07265-a7d6-4d7e-b477-5904c49ffab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.097009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba07265-a7d6-4d7e-b477-5904c49ffab1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-8ba07265-a7d6-4d7e-b477-5904c49ffab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:14.112782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:14.113686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 322/644] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:14.114757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba07265-a7d6-4d7e-b477-5904c49ffab1 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.123961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 323/645] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:14.124824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fc5a0-8090-42b2-8bac-fc7f0b438874 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.196570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:14.229997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fc5a0-8090-42b2-8bac-fc7f0b438874 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.233685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba07265-a7d6-4d7e-b477-5904c49ffab1 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.263600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:14.267469 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395ee6c-159d-45f0-869f-434c053dd226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.268152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395ee6c-159d-45f0-869f-434c053dd226 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.268444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395ee6c-159d-45f0-869f-434c053dd226 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.268771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395ee6c-159d-45f0-869f-434c053dd226 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.269584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395ee6c-159d-45f0-869f-434c053dd226 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:14.269902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395ee6c-159d-45f0-869f-434c053dd226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.283059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fd3bb-5a11-45e7-95fd-3e3a2b42f355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.283059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fd3bb-5a11-45e7-95fd-3e3a2b42f355 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.283059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fd3bb-5a11-45e7-95fd-3e3a2b42f355 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.283059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fd3bb-5a11-45e7-95fd-3e3a2b42f355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.283367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395ee6c-159d-45f0-869f-434c053dd226 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.284572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fd3bb-5a11-45e7-95fd-3e3a2b42f355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.286077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fd3bb-5a11-45e7-95fd-3e3a2b42f355 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.295471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 324/646] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:14.295471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395ee6c-159d-45f0-869f-434c053dd226 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-3f5fd3bb-5a11-45e7-95fd-3e3a2b42f355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:14.310828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:14.311774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:14.312673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:14.312673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:14.312673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:14.312673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:14.312673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 323/647] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:14.313390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fd3bb-5a11-45e7-95fd-3e3a2b42f355 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.406213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395ee6c-159d-45f0-869f-434c053dd226 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.419509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fd3bb-5a11-45e7-95fd-3e3a2b42f355 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.441103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:14.452447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2de6bf-89da-42ab-aec2-867f6b40a9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.453287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2de6bf-89da-42ab-aec2-867f6b40a9bd None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.453658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2de6bf-89da-42ab-aec2-867f6b40a9bd None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.453951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2de6bf-89da-42ab-aec2-867f6b40a9bd None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.455022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2de6bf-89da-42ab-aec2-867f6b40a9bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:14.455419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2de6bf-89da-42ab-aec2-867f6b40a9bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.455961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05664e4-7753-4800-8195-1c9ed71de11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.456764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05664e4-7753-4800-8195-1c9ed71de11e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.456879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2de6bf-89da-42ab-aec2-867f6b40a9bd None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.457042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05664e4-7753-4800-8195-1c9ed71de11e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.457328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05664e4-7753-4800-8195-1c9ed71de11e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.468730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05664e4-7753-4800-8195-1c9ed71de11e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:14.475345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 325/648] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:14.475345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2de6bf-89da-42ab-aec2-867f6b40a9bd None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-b05664e4-7753-4800-8195-1c9ed71de11e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:14.476846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:14.477723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:14.478646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 324/649] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:14.480210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05664e4-7753-4800-8195-1c9ed71de11e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.527641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:14.581284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2de6bf-89da-42ab-aec2-867f6b40a9bd None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.589707 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05664e4-7753-4800-8195-1c9ed71de11e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.618535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57099d21-589d-49a3-8a8a-f2f721f9c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.619195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57099d21-589d-49a3-8a8a-f2f721f9c201 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.620014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57099d21-589d-49a3-8a8a-f2f721f9c201 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.620301 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57099d21-589d-49a3-8a8a-f2f721f9c201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.626729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1efe3-1f48-41ca-a5f2-a05ac15c5ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.627616 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1efe3-1f48-41ca-a5f2-a05ac15c5ec4 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.628134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1efe3-1f48-41ca-a5f2-a05ac15c5ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.628620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1efe3-1f48-41ca-a5f2-a05ac15c5ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.629531 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1efe3-1f48-41ca-a5f2-a05ac15c5ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:14.630054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1efe3-1f48-41ca-a5f2-a05ac15c5ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.631625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1efe3-1f48-41ca-a5f2-a05ac15c5ec4 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.649475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 325/650] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:14.650551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1efe3-1f48-41ca-a5f2-a05ac15c5ec4 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.677498 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:14.690599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57099d21-589d-49a3-8a8a-f2f721f9c201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.692060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57099d21-589d-49a3-8a8a-f2f721f9c201 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.756218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1efe3-1f48-41ca-a5f2-a05ac15c5ec4 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.757733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:14.797216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb380eb-a06a-44a0-ac5f-c6fa25f3e663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.797437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 326/651] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:14.797437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57099d21-589d-49a3-8a8a-f2f721f9c201 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.797608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb380eb-a06a-44a0-ac5f-c6fa25f3e663 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.797608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb380eb-a06a-44a0-ac5f-c6fa25f3e663 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.797608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb380eb-a06a-44a0-ac5f-c6fa25f3e663 None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/f93427bde8154d509bc67675b03903db/roles/449d76dce6534ca9b28d0a003483d951` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.813859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb380eb-a06a-44a0-ac5f-c6fa25f3e663 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=f93427bde8154d509bc67675b03903db, role_id=449d76dce6534ca9b28d0a003483d951)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.815648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb380eb-a06a-44a0-ac5f-c6fa25f3e663 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.884465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:14.897484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 326/652] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:33:14 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/f93427bde8154d509bc67675b03903db/roles/449d76dce6534ca9b28d0a003483d951 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:33:14.898986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57099d21-589d-49a3-8a8a-f2f721f9c201 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.906983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb380eb-a06a-44a0-ac5f-c6fa25f3e663 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.946419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4b668-208f-488f-9463-8e3a54685195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.947346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4b668-208f-488f-9463-8e3a54685195 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.947734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4b668-208f-488f-9463-8e3a54685195 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.948157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4b668-208f-488f-9463-8e3a54685195 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.949247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4b668-208f-488f-9463-8e3a54685195 None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:14.949554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4b668-208f-488f-9463-8e3a54685195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.951841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4b668-208f-488f-9463-8e3a54685195 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.968016 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 327/653] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:14.968016 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4b668-208f-488f-9463-8e3a54685195 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.056930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb380eb-a06a-44a0-ac5f-c6fa25f3e663 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:15.096679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4b668-208f-488f-9463-8e3a54685195 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:15.098227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753e408-4330-4509-b48d-0a04b60cbb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:15.099620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753e408-4330-4509-b48d-0a04b60cbb90 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:15.099620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753e408-4330-4509-b48d-0a04b60cbb90 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:15.099900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753e408-4330-4509-b48d-0a04b60cbb90 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:15.111145 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753e408-4330-4509-b48d-0a04b60cbb90 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:15.113066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753e408-4330-4509-b48d-0a04b60cbb90 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1753e408-4330-4509-b48d-0a04b60cbb90 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:15.131331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:15.132374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:15.133304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 327/654] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:15.133891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753e408-4330-4509-b48d-0a04b60cbb90 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.148532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df12949-49b7-4c1c-ab52-9fd2cf35a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:15.149618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df12949-49b7-4c1c-ab52-9fd2cf35a579 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:15.149904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df12949-49b7-4c1c-ab52-9fd2cf35a579 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:15.150227 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df12949-49b7-4c1c-ab52-9fd2cf35a579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:15.151247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:15.167167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df12949-49b7-4c1c-ab52-9fd2cf35a579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:15.168803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df12949-49b7-4c1c-ab52-9fd2cf35a579 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-8df12949-49b7-4c1c-ab52-9fd2cf35a579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:15.191222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:15.192206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:15.193074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:15.193074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:15.193074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:15.193074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:15.193290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 328/655] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:15.194181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df12949-49b7-4c1c-ab52-9fd2cf35a579 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.198085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:15.249030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753e408-4330-4509-b48d-0a04b60cbb90 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:15.286948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cd868-bb7b-4bd9-96ba-05c21263a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:15.287971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cd868-bb7b-4bd9-96ba-05c21263a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:15.288426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cd868-bb7b-4bd9-96ba-05c21263a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:15.288777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cd868-bb7b-4bd9-96ba-05c21263a7d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:15.301226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cd868-bb7b-4bd9-96ba-05c21263a7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:15.302843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cd868-bb7b-4bd9-96ba-05c21263a7d0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:15.304566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df12949-49b7-4c1c-ab52-9fd2cf35a579 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-682cd868-bb7b-4bd9-96ba-05c21263a7d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:15.321812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:15.323902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:15.326016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:15.326016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:15.326016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:15.326016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:15.329345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 328/656] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:15.329345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cd868-bb7b-4bd9-96ba-05c21263a7d0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.340193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b777085-7f3e-4a2b-b571-da191735a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:15.340869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b777085-7f3e-4a2b-b571-da191735a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:15.341266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b777085-7f3e-4a2b-b571-da191735a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:15.341554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b777085-7f3e-4a2b-b571-da191735a2a4 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:15.342435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b777085-7f3e-4a2b-b571-da191735a2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:15.342858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b777085-7f3e-4a2b-b571-da191735a2a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:15.344463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b777085-7f3e-4a2b-b571-da191735a2a4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:15.364642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 329/657] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jun 30 10:33:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:15.365491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b777085-7f3e-4a2b-b571-da191735a2a4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.403774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:15.432473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:15.452960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cd868-bb7b-4bd9-96ba-05c21263a7d0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:15.484504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b777085-7f3e-4a2b-b571-da191735a2a4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:15.500112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53f8ce-c9cc-4ef8-802d-24bd9a6d5484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:15.501040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53f8ce-c9cc-4ef8-802d-24bd9a6d5484 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:15.501693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53f8ce-c9cc-4ef8-802d-24bd9a6d5484 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:15.502634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53f8ce-c9cc-4ef8-802d-24bd9a6d5484 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:15.503843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53f8ce-c9cc-4ef8-802d-24bd9a6d5484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:15.504345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53f8ce-c9cc-4ef8-802d-24bd9a6d5484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:15.506530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53f8ce-c9cc-4ef8-802d-24bd9a6d5484 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:15.523788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 329/658] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:15.524973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53f8ce-c9cc-4ef8-802d-24bd9a6d5484 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.525337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc28d0-32eb-4116-b454-0e0dc0bb4b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:15.526684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc28d0-32eb-4116-b454-0e0dc0bb4b82 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:15.526971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc28d0-32eb-4116-b454-0e0dc0bb4b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:15.527248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc28d0-32eb-4116-b454-0e0dc0bb4b82 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:15.527980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc28d0-32eb-4116-b454-0e0dc0bb4b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:15.528287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc28d0-32eb-4116-b454-0e0dc0bb4b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:15.530211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc28d0-32eb-4116-b454-0e0dc0bb4b82 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:15.545312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 330/659] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:15.546587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc28d0-32eb-4116-b454-0e0dc0bb4b82 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.649594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53f8ce-c9cc-4ef8-802d-24bd9a6d5484 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:15.662466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc28d0-32eb-4116-b454-0e0dc0bb4b82 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:15.676742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:15.683451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:15.689439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20e856-61f5-4a21-bd8e-9a7f7cc0483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:15.690388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20e856-61f5-4a21-bd8e-9a7f7cc0483b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:15.690890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20e856-61f5-4a21-bd8e-9a7f7cc0483b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:15.691392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20e856-61f5-4a21-bd8e-9a7f7cc0483b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:15.699412 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59d893-5440-4970-af7f-979fa53793cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:15.700220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59d893-5440-4970-af7f-979fa53793cf None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:15.700508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59d893-5440-4970-af7f-979fa53793cf None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:15.700787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59d893-5440-4970-af7f-979fa53793cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:15.708105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59d893-5440-4970-af7f-979fa53793cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:15.709621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59d893-5440-4970-af7f-979fa53793cf None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-4b59d893-5440-4970-af7f-979fa53793cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:15.726104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:15.727124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:15.728081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:15.728081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:15.728081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:15.728081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:15.728081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:15.728081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:15.728081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:15.728081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:15.732285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 331/660] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:15.733120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59d893-5440-4970-af7f-979fa53793cf None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.767961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20e856-61f5-4a21-bd8e-9a7f7cc0483b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:15.769768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20e856-61f5-4a21-bd8e-9a7f7cc0483b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:15.835521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59d893-5440-4970-af7f-979fa53793cf None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:15.871728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b15ce-2128-45fc-bb98-f55107ea6924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:15.872707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b15ce-2128-45fc-bb98-f55107ea6924 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:15.873002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b15ce-2128-45fc-bb98-f55107ea6924 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:15.873284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b15ce-2128-45fc-bb98-f55107ea6924 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:15.874429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 330/661] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:15.875463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20e856-61f5-4a21-bd8e-9a7f7cc0483b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.885432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b15ce-2128-45fc-bb98-f55107ea6924 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:15.886957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b15ce-2128-45fc-bb98-f55107ea6924 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-141b15ce-2128-45fc-bb98-f55107ea6924 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:15.902821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:15.903855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:33:15.904798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:15.908632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 332/662] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:15.909467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b15ce-2128-45fc-bb98-f55107ea6924 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:15.985652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:15.992019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20e856-61f5-4a21-bd8e-9a7f7cc0483b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.009797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b15ce-2128-45fc-bb98-f55107ea6924 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.027611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052870-6281-49e8-86d4-6f595f455611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:16.028731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052870-6281-49e8-86d4-6f595f455611 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.029028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052870-6281-49e8-86d4-6f595f455611 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.029310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052870-6281-49e8-86d4-6f595f455611 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.030135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052870-6281-49e8-86d4-6f595f455611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:16.030454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052870-6281-49e8-86d4-6f595f455611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:16.031915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052870-6281-49e8-86d4-6f595f455611 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:16.033884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:16.044422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 331/663] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:16.045231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052870-6281-49e8-86d4-6f595f455611 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:16.051090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d844f-ae80-4a1f-a53f-beb6342d9486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:16.051958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d844f-ae80-4a1f-a53f-beb6342d9486 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.052249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d844f-ae80-4a1f-a53f-beb6342d9486 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.052528 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d844f-ae80-4a1f-a53f-beb6342d9486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.063622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d844f-ae80-4a1f-a53f-beb6342d9486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:16.068066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d844f-ae80-4a1f-a53f-beb6342d9486 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-6b9d844f-ae80-4a1f-a53f-beb6342d9486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:16.083595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:16.084763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:16.085766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:16.085766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:16.085766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:16.085766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:16.085766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 333/664] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:16.086458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66370-f470-4bb6-8ca1-01cf323649e3 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.087272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66370-f470-4bb6-8ca1-01cf323649e3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.087989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66370-f470-4bb6-8ca1-01cf323649e3 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.094218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 334/665] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:16.094218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66370-f470-4bb6-8ca1-01cf323649e3 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:16.152414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:16.168334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052870-6281-49e8-86d4-6f595f455611 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.189529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:16.200852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66370-f470-4bb6-8ca1-01cf323649e3 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.205049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff275e-cf40-4de1-b1f5-33feb5368cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:16.205971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff275e-cf40-4de1-b1f5-33feb5368cec None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.206432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff275e-cf40-4de1-b1f5-33feb5368cec None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.206878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff275e-cf40-4de1-b1f5-33feb5368cec None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.208030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff275e-cf40-4de1-b1f5-33feb5368cec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:16.208356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff275e-cf40-4de1-b1f5-33feb5368cec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:16.210126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff275e-cf40-4de1-b1f5-33feb5368cec None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:16.234159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 332/666] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jun 30 10:33:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:16.234159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff275e-cf40-4de1-b1f5-33feb5368cec None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:16.239348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ec5da-4ee4-45ce-b379-a20a8dc3607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:16.240003 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ec5da-4ee4-45ce-b379-a20a8dc3607f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.240292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ec5da-4ee4-45ce-b379-a20a8dc3607f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.240568 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ec5da-4ee4-45ce-b379-a20a8dc3607f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.241404 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ec5da-4ee4-45ce-b379-a20a8dc3607f None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=9e839d1074f24a5ba7a552472e167067) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:16.241718 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ec5da-4ee4-45ce-b379-a20a8dc3607f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:16.243176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ec5da-4ee4-45ce-b379-a20a8dc3607f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:16.249626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 335/667] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:16 2022] GET /identity/v3/role_assignments?user.id=9e839d1074f24a5ba7a552472e167067&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:16.250796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922993f-1599-4c55-8245-87521c3fb349 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.251086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922993f-1599-4c55-8245-87521c3fb349 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.251362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922993f-1599-4c55-8245-87521c3fb349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.271136 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-8922993f-1599-4c55-8245-87521c3fb349 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:16.272336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8922993f-1599-4c55-8245-87521c3fb349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:16.357077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff275e-cf40-4de1-b1f5-33feb5368cec None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.364246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 336/668] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:16.365202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922993f-1599-4c55-8245-87521c3fb349 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:16.414479 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8147-e529-4fae-ac47-6d4e21bde4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:16.415167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8147-e529-4fae-ac47-6d4e21bde4ea None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.415723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8147-e529-4fae-ac47-6d4e21bde4ea None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.416008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8147-e529-4fae-ac47-6d4e21bde4ea None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.417796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc8147-e529-4fae-ac47-6d4e21bde4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:16.418477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc8147-e529-4fae-ac47-6d4e21bde4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:16.420595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc8147-e529-4fae-ac47-6d4e21bde4ea None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:16.441681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 333/669] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:16.442676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8147-e529-4fae-ac47-6d4e21bde4ea None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:16.448426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:16.502871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:16.519450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922993f-1599-4c55-8245-87521c3fb349 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.566881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6ea38-174a-43ba-b0b2-fcc0a66f5a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:16.567657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6ea38-174a-43ba-b0b2-fcc0a66f5a30 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.568064 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6ea38-174a-43ba-b0b2-fcc0a66f5a30 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.568365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6ea38-174a-43ba-b0b2-fcc0a66f5a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.576259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8147-e529-4fae-ac47-6d4e21bde4ea None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.613559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8f9f1-9119-451b-afe3-89d287fad864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:16.614507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8f9f1-9119-451b-afe3-89d287fad864 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.614801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8f9f1-9119-451b-afe3-89d287fad864 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.615086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8f9f1-9119-451b-afe3-89d287fad864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.626666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8f9f1-9119-451b-afe3-89d287fad864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-eac8f9f1-9119-451b-afe3-89d287fad864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:16.634598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:16.635760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:16.636631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 334/670] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:16.637346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8f9f1-9119-451b-afe3-89d287fad864 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:16.657201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6ea38-174a-43ba-b0b2-fcc0a66f5a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:16.659411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6ea38-174a-43ba-b0b2-fcc0a66f5a30 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:16.712261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:16.758133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8f9f1-9119-451b-afe3-89d287fad864 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.769103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:16.793145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 337/671] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:16.794754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6ea38-174a-43ba-b0b2-fcc0a66f5a30 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:16.798383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aab0d5-8117-4dca-8987-ea3b583a74c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:16.799439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab0d5-8117-4dca-8987-ea3b583a74c3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.799712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab0d5-8117-4dca-8987-ea3b583a74c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.800095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab0d5-8117-4dca-8987-ea3b583a74c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.809073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aab0d5-8117-4dca-8987-ea3b583a74c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:16.810780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aab0d5-8117-4dca-8987-ea3b583a74c3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-40aab0d5-8117-4dca-8987-ea3b583a74c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:16.828392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:16.829401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:16.830423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:16.830423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:16.830423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:16.830423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:16.830423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:16.830423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:16.830423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:16.830423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:16.830423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 335/672] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:16.831731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aab0d5-8117-4dca-8987-ea3b583a74c3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:16.926142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6ea38-174a-43ba-b0b2-fcc0a66f5a30 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.967050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aab0d5-8117-4dca-8987-ea3b583a74c3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:16.968029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a7c4-a000-4472-8f35-6143a1598aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:16.968780 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a7c4-a000-4472-8f35-6143a1598aff None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:16.969142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a7c4-a000-4472-8f35-6143a1598aff None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:16.969496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a7c4-a000-4472-8f35-6143a1598aff None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:16.970539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a7c4-a000-4472-8f35-6143a1598aff None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:16.970937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a7c4-a000-4472-8f35-6143a1598aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:16.973210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a7c4-a000-4472-8f35-6143a1598aff None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:16.984687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 338/673] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:16.985680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a7c4-a000-4472-8f35-6143a1598aff None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.000884 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:17.016252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7516-5915-4de4-b0f0-f854ccc8ef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.017558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7516-5915-4de4-b0f0-f854ccc8ef17 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.018203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7516-5915-4de4-b0f0-f854ccc8ef17 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.018677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7516-5915-4de4-b0f0-f854ccc8ef17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.034965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c7516-5915-4de4-b0f0-f854ccc8ef17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.038400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c7516-5915-4de4-b0f0-f854ccc8ef17 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.048487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-422c7516-5915-4de4-b0f0-f854ccc8ef17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:17.062038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:17.062970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:17.063868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:17.063868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:17.063868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:17.063868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:17.063868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 336/674] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:17.064604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7516-5915-4de4-b0f0-f854ccc8ef17 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.102318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a7c4-a000-4472-8f35-6143a1598aff None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.139090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45463e55-6389-4c5d-ad25-75750b904778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.140253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463e55-6389-4c5d-ad25-75750b904778 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.140865 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463e55-6389-4c5d-ad25-75750b904778 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.141319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463e55-6389-4c5d-ad25-75750b904778 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.142155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45463e55-6389-4c5d-ad25-75750b904778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:17.142475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45463e55-6389-4c5d-ad25-75750b904778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.143908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45463e55-6389-4c5d-ad25-75750b904778 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.162328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 339/675] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:17.163086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45463e55-6389-4c5d-ad25-75750b904778 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.171100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7516-5915-4de4-b0f0-f854ccc8ef17 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.205333 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36649f4d-da06-4614-bd06-4b07948fc4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.206170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36649f4d-da06-4614-bd06-4b07948fc4fe None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.206461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36649f4d-da06-4614-bd06-4b07948fc4fe None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.206738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36649f4d-da06-4614-bd06-4b07948fc4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.219183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36649f4d-da06-4614-bd06-4b07948fc4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.220570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36649f4d-da06-4614-bd06-4b07948fc4fe None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-36649f4d-da06-4614-bd06-4b07948fc4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:17.239125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:17.240016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:17.240897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:17.240897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:17.240897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:17.240897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:17.240897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 337/676] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:17.242323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034be235-4ad4-4797-b748-0f1c4d99296f None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.242323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034be235-4ad4-4797-b748-0f1c4d99296f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.242323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034be235-4ad4-4797-b748-0f1c4d99296f None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.243538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 338/677] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:17.248235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034be235-4ad4-4797-b748-0f1c4d99296f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.273663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45463e55-6389-4c5d-ad25-75750b904778 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.278306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:17.284167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:17.308014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66066ed6-1773-4e74-b9a0-b52a637a00e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.308748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66066ed6-1773-4e74-b9a0-b52a637a00e3 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.309094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66066ed6-1773-4e74-b9a0-b52a637a00e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.309292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66066ed6-1773-4e74-b9a0-b52a637a00e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.310050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66066ed6-1773-4e74-b9a0-b52a637a00e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:17.310369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66066ed6-1773-4e74-b9a0-b52a637a00e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.318076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66066ed6-1773-4e74-b9a0-b52a637a00e3 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.323481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 340/678] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:17.324276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66066ed6-1773-4e74-b9a0-b52a637a00e3 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.360863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034be235-4ad4-4797-b748-0f1c4d99296f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.397428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dbb1-c5e4-407f-a063-53a258e47cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.398109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dbb1-c5e4-407f-a063-53a258e47cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.398454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dbb1-c5e4-407f-a063-53a258e47cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.398735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dbb1-c5e4-407f-a063-53a258e47cd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.399560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dbb1-c5e4-407f-a063-53a258e47cd8 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=19fd3da30bdb477e99dbbc2f7075f161) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:17.399875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dbb1-c5e4-407f-a063-53a258e47cd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.401312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dbb1-c5e4-407f-a063-53a258e47cd8 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.413980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 339/679] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/role_assignments?user.id=19fd3da30bdb477e99dbbc2f7075f161&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:17.413980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10f7a2-46af-4cdf-b35b-da2681876cb0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.413980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10f7a2-46af-4cdf-b35b-da2681876cb0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.413980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10f7a2-46af-4cdf-b35b-da2681876cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.428270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ed10f7a2-46af-4cdf-b35b-da2681876cb0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:17.429527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ed10f7a2-46af-4cdf-b35b-da2681876cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:17.448412 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66066ed6-1773-4e74-b9a0-b52a637a00e3 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.494194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eebeee-e2bd-4e8a-b999-400314e38269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.495347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eebeee-e2bd-4e8a-b999-400314e38269 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.495634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eebeee-e2bd-4e8a-b999-400314e38269 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.495914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eebeee-e2bd-4e8a-b999-400314e38269 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.496660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eebeee-e2bd-4e8a-b999-400314e38269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:17.497035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eebeee-e2bd-4e8a-b999-400314e38269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.498516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eebeee-e2bd-4e8a-b999-400314e38269 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.513681 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 341/680] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:17.514753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eebeee-e2bd-4e8a-b999-400314e38269 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.518004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 340/681] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:17.519458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10f7a2-46af-4cdf-b35b-da2681876cb0 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.548664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:17.570051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:17.644843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10f7a2-46af-4cdf-b35b-da2681876cb0 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.656966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eebeee-e2bd-4e8a-b999-400314e38269 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.682840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b2c1a-94fc-4ed0-80fa-1ef9f0f17663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.684073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2c1a-94fc-4ed0-80fa-1ef9f0f17663 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.684407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2c1a-94fc-4ed0-80fa-1ef9f0f17663 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.684947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2c1a-94fc-4ed0-80fa-1ef9f0f17663 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.694876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b2c1a-94fc-4ed0-80fa-1ef9f0f17663 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.696722 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b2c1a-94fc-4ed0-80fa-1ef9f0f17663 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.697352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2cb8-79be-4ef0-bb7c-69bd584c8b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.698801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2cb8-79be-4ef0-bb7c-69bd584c8b17 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.699191 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2cb8-79be-4ef0-bb7c-69bd584c8b17 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.699577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2cb8-79be-4ef0-bb7c-69bd584c8b17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.706554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2cb8-79be-4ef0-bb7c-69bd584c8b17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.708243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2cb8-79be-4ef0-bb7c-69bd584c8b17 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1c3b2c1a-94fc-4ed0-80fa-1ef9f0f17663 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:17.713680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:17.714752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:17.715732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 341/682] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:17.716421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b2c1a-94fc-4ed0-80fa-1ef9f0f17663 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-223c2cb8-79be-4ef0-bb7c-69bd584c8b17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:17.724050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:17.725171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:17.726330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:17.726330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:17.726330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:17.726330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:17.726330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:17.726330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:17.726330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:17.726330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:17.733051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 342/683] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:17.734080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2cb8-79be-4ef0-bb7c-69bd584c8b17 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.813872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:17.828854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:17.834679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b2c1a-94fc-4ed0-80fa-1ef9f0f17663 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.843340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2cb8-79be-4ef0-bb7c-69bd584c8b17 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.872116 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160ce41-f2a8-483c-9d3a-43c10413d80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.873217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160ce41-f2a8-483c-9d3a-43c10413d80f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.873648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160ce41-f2a8-483c-9d3a-43c10413d80f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.874129 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160ce41-f2a8-483c-9d3a-43c10413d80f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.885139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160ce41-f2a8-483c-9d3a-43c10413d80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-c160ce41-f2a8-483c-9d3a-43c10413d80f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:17.896187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:17.897172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:17.898056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:17.904704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 342/684] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:17.904704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160ce41-f2a8-483c-9d3a-43c10413d80f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.907667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd18f3-dd58-4980-8122-e15c182eb1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.908871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd18f3-dd58-4980-8122-e15c182eb1b1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.909298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd18f3-dd58-4980-8122-e15c182eb1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.909716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd18f3-dd58-4980-8122-e15c182eb1b1 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.911234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd18f3-dd58-4980-8122-e15c182eb1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:17.911816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd18f3-dd58-4980-8122-e15c182eb1b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.914046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd18f3-dd58-4980-8122-e15c182eb1b1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.937708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 343/685] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:17.938717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd18f3-dd58-4980-8122-e15c182eb1b1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:18.021955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160ce41-f2a8-483c-9d3a-43c10413d80f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:18.042289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd18f3-dd58-4980-8122-e15c182eb1b1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:18.060274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b045b0-3651-4d41-af85-4a6bddfa7056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:18.061365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b045b0-3651-4d41-af85-4a6bddfa7056 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.061871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b045b0-3651-4d41-af85-4a6bddfa7056 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.062385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b045b0-3651-4d41-af85-4a6bddfa7056 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.063362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b045b0-3651-4d41-af85-4a6bddfa7056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:18.063989 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b045b0-3651-4d41-af85-4a6bddfa7056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:18.065614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b045b0-3651-4d41-af85-4a6bddfa7056 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:18.076429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:18.078010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ef04-3e52-4e38-905e-15a4b585255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:18.078690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ef04-3e52-4e38-905e-15a4b585255d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.078978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ef04-3e52-4e38-905e-15a4b585255d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.079258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ef04-3e52-4e38-905e-15a4b585255d None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.080008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ef04-3e52-4e38-905e-15a4b585255d None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:18.080338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ef04-3e52-4e38-905e-15a4b585255d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:18.082034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ef04-3e52-4e38-905e-15a4b585255d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:18.083042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 343/686] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:18.084053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b045b0-3651-4d41-af85-4a6bddfa7056 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:18.096052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 344/687] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:18.100844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ef04-3e52-4e38-905e-15a4b585255d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:18.112714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:18.199664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b045b0-3651-4d41-af85-4a6bddfa7056 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:18.213725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ef04-3e52-4e38-905e-15a4b585255d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:18.243514 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f00646-25c0-4160-9b21-799253cadac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:18.244601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f00646-25c0-4160-9b21-799253cadac9 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.245141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f00646-25c0-4160-9b21-799253cadac9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.245633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f00646-25c0-4160-9b21-799253cadac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.256277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a2384-b1f8-46e7-beed-cfbdf74a0ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:18.257297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a2384-b1f8-46e7-beed-cfbdf74a0ca2 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.257748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a2384-b1f8-46e7-beed-cfbdf74a0ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.258218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a2384-b1f8-46e7-beed-cfbdf74a0ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.259554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a2384-b1f8-46e7-beed-cfbdf74a0ca2 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=719afb6dcb154119beb18d2f1974fe2e) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:18.260147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a2384-b1f8-46e7-beed-cfbdf74a0ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:18.262460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a2384-b1f8-46e7-beed-cfbdf74a0ca2 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:18.278128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 345/688] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:18 2022] GET /identity/v3/role_assignments?user.id=719afb6dcb154119beb18d2f1974fe2e&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:18.279537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a2384-b1f8-46e7-beed-cfbdf74a0ca2 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:18.320738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:18.324215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f00646-25c0-4160-9b21-799253cadac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:18.326112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f00646-25c0-4160-9b21-799253cadac9 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:18.419879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:18.442139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 344/689] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:18.451300 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f00646-25c0-4160-9b21-799253cadac9 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:18.462744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a2384-b1f8-46e7-beed-cfbdf74a0ca2 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:18.500867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30e976-c962-435a-8c8f-a5d5619fe549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:18.501602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30e976-c962-435a-8c8f-a5d5619fe549 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.501891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30e976-c962-435a-8c8f-a5d5619fe549 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.502273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30e976-c962-435a-8c8f-a5d5619fe549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.515327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30e976-c962-435a-8c8f-a5d5619fe549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:18.516788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30e976-c962-435a-8c8f-a5d5619fe549 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-1c30e976-c962-435a-8c8f-a5d5619fe549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:18.540033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:18.540996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:18.541953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:18.541953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:18.541953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:18.541953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:18.546180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 346/690] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:18.547801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107ef11-b90f-495b-9a5e-f763d9d7c661 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.548030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107ef11-b90f-495b-9a5e-f763d9d7c661 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.548289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107ef11-b90f-495b-9a5e-f763d9d7c661 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.550066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 347/691] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:18.550849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107ef11-b90f-495b-9a5e-f763d9d7c661 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:18.603150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:18.606450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f00646-25c0-4160-9b21-799253cadac9 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:18.659755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8c2c7-c291-471f-b870-12935025088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:18.660594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8c2c7-c291-471f-b870-12935025088b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.660905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8c2c7-c291-471f-b870-12935025088b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.661158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8c2c7-c291-471f-b870-12935025088b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.676074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8c2c7-c291-471f-b870-12935025088b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:18.677515 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8c2c7-c291-471f-b870-12935025088b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:18.694191 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107ef11-b90f-495b-9a5e-f763d9d7c661 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-42f8c2c7-c291-471f-b870-12935025088b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:18.703098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:18.704071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:18.705001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:18.705001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:18.705001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:18.705001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:18.707734 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 345/692] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:18.709389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842b3c-1333-4dbd-93d7-106c6a8b66f4 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.710095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842b3c-1333-4dbd-93d7-106c6a8b66f4 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.710518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842b3c-1333-4dbd-93d7-106c6a8b66f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.722694 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:18.734308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b92f-f581-4b85-8d11-6e69a89f10f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:18.739279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-94842b3c-1333-4dbd-93d7-106c6a8b66f4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:18.739394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b92f-f581-4b85-8d11-6e69a89f10f1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.739394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b92f-f581-4b85-8d11-6e69a89f10f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.739394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b92f-f581-4b85-8d11-6e69a89f10f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.739615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-94842b3c-1333-4dbd-93d7-106c6a8b66f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:18.739710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689b92f-f581-4b85-8d11-6e69a89f10f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:18.739710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689b92f-f581-4b85-8d11-6e69a89f10f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:18.739710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689b92f-f581-4b85-8d11-6e69a89f10f1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:18.752270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 348/693] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:18.753193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b92f-f581-4b85-8d11-6e69a89f10f1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:18.808953 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 346/694] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:18.810041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842b3c-1333-4dbd-93d7-106c6a8b66f4 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:18.893292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b92f-f581-4b85-8d11-6e69a89f10f1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:18.901058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:18.922362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842b3c-1333-4dbd-93d7-106c6a8b66f4 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:18.929123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a0e5-5c60-46de-a372-c4fea6d52ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:18.929915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a0e5-5c60-46de-a372-c4fea6d52ad2 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.930342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a0e5-5c60-46de-a372-c4fea6d52ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.930730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a0e5-5c60-46de-a372-c4fea6d52ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.932202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a0e5-5c60-46de-a372-c4fea6d52ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:18.932577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a0e5-5c60-46de-a372-c4fea6d52ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:18.934085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a0e5-5c60-46de-a372-c4fea6d52ad2 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:18.946420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 349/695] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:18.948150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a0e5-5c60-46de-a372-c4fea6d52ad2 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:18.963273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30ef5b-eca2-451f-8419-af6c5dd84c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:18.964386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30ef5b-eca2-451f-8419-af6c5dd84c64 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:18.964812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30ef5b-eca2-451f-8419-af6c5dd84c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:18.965233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30ef5b-eca2-451f-8419-af6c5dd84c64 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:18.973567 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30ef5b-eca2-451f-8419-af6c5dd84c64 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:18.975460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30ef5b-eca2-451f-8419-af6c5dd84c64 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-3e30ef5b-eca2-451f-8419-af6c5dd84c64 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:18.991485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:18.992478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:18.993418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:18.996741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 347/696] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:18.997719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30ef5b-eca2-451f-8419-af6c5dd84c64 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:19.001657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:19.058161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a0e5-5c60-46de-a372-c4fea6d52ad2 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.093686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603fdbd-b4fb-4e82-8774-fe4696455196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.094618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fdbd-b4fb-4e82-8774-fe4696455196 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.094979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fdbd-b4fb-4e82-8774-fe4696455196 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.095335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fdbd-b4fb-4e82-8774-fe4696455196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.106689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603fdbd-b4fb-4e82-8774-fe4696455196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.108266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603fdbd-b4fb-4e82-8774-fe4696455196 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:19.110773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30ef5b-eca2-451f-8419-af6c5dd84c64 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-b603fdbd-b4fb-4e82-8774-fe4696455196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:19.127456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:19.128425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:19.129311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:19.129311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:19.129311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:19.129311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:19.133453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 350/697] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:19.134330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603fdbd-b4fb-4e82-8774-fe4696455196 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:19.151597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736b63-93d2-4ffa-80a9-7603b392cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.152708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736b63-93d2-4ffa-80a9-7603b392cd80 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.153208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736b63-93d2-4ffa-80a9-7603b392cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.153788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736b63-93d2-4ffa-80a9-7603b392cd80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.161493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736b63-93d2-4ffa-80a9-7603b392cd80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.163324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736b63-93d2-4ffa-80a9-7603b392cd80 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-fa736b63-93d2-4ffa-80a9-7603b392cd80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:19.178108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:19.179053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:19.179955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:19.179955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:19.179955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:19.179955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:19.179955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:19.179955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:19.179955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:19.179955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:19.183076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 348/698] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:19.184192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736b63-93d2-4ffa-80a9-7603b392cd80 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:19.187382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:19.234743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:19.240476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603fdbd-b4fb-4e82-8774-fe4696455196 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.278903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ddd44-8d2e-4676-97e5-ea0fd6383372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.280530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ddd44-8d2e-4676-97e5-ea0fd6383372 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.281148 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ddd44-8d2e-4676-97e5-ea0fd6383372 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.281628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ddd44-8d2e-4676-97e5-ea0fd6383372 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.283258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ddd44-8d2e-4676-97e5-ea0fd6383372 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:19.283774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ddd44-8d2e-4676-97e5-ea0fd6383372 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.285427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ddd44-8d2e-4676-97e5-ea0fd6383372 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:19.303088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736b63-93d2-4ffa-80a9-7603b392cd80 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.313989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 351/699] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 10:33:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:19.315090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ddd44-8d2e-4676-97e5-ea0fd6383372 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:19.349516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94591cc-5b07-43ca-822c-ffa0847b61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.350220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94591cc-5b07-43ca-822c-ffa0847b61a1 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.350512 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94591cc-5b07-43ca-822c-ffa0847b61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.350799 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94591cc-5b07-43ca-822c-ffa0847b61a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.351693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94591cc-5b07-43ca-822c-ffa0847b61a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:19.352012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94591cc-5b07-43ca-822c-ffa0847b61a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.354755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94591cc-5b07-43ca-822c-ffa0847b61a1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:19.374020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 349/700] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:19.375154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94591cc-5b07-43ca-822c-ffa0847b61a1 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:19.435152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ddd44-8d2e-4676-97e5-ea0fd6383372 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.451342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:19.483044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10fae4-a75f-4201-a9d9-2c209149a56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.484320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10fae4-a75f-4201-a9d9-2c209149a56e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.484795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10fae4-a75f-4201-a9d9-2c209149a56e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.485409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10fae4-a75f-4201-a9d9-2c209149a56e None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.486549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10fae4-a75f-4201-a9d9-2c209149a56e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:19.486868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10fae4-a75f-4201-a9d9-2c209149a56e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.488528 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10fae4-a75f-4201-a9d9-2c209149a56e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:19.497236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94591cc-5b07-43ca-822c-ffa0847b61a1 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.504114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 352/701] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:19.504923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10fae4-a75f-4201-a9d9-2c209149a56e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:19.520901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:19.544779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0590da-14c6-40d3-bd87-1688e8417452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.546356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0590da-14c6-40d3-bd87-1688e8417452 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.546875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0590da-14c6-40d3-bd87-1688e8417452 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.547360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0590da-14c6-40d3-bd87-1688e8417452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.623159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0590da-14c6-40d3-bd87-1688e8417452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.624627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0590da-14c6-40d3-bd87-1688e8417452 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:19.625074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10fae4-a75f-4201-a9d9-2c209149a56e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.662990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3c209-3d57-4fe2-a9f1-c74fe01fbb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.663827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3c209-3d57-4fe2-a9f1-c74fe01fbb5b None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.664120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3c209-3d57-4fe2-a9f1-c74fe01fbb5b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.664402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3c209-3d57-4fe2-a9f1-c74fe01fbb5b None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.665109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3c209-3d57-4fe2-a9f1-c74fe01fbb5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.667142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3c209-3d57-4fe2-a9f1-c74fe01fbb5b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:19.689679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:19.728076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 350/702] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:19.729535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0590da-14c6-40d3-bd87-1688e8417452 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:19.776662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 353/703] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:33:19 2022] POST /identity/v3/users => generated 254 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:19.778002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23dd6-b251-45f2-9e38-a45c20348eb6 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.778302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23dd6-b251-45f2-9e38-a45c20348eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.778589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23dd6-b251-45f2-9e38-a45c20348eb6 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.780047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 354/704] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:19.785208 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23dd6-b251-45f2-9e38-a45c20348eb6 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:19.860786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0590da-14c6-40d3-bd87-1688e8417452 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.866354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:19.920760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbd7f9-ae8a-4f74-b834-abc382536ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.921521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbd7f9-ae8a-4f74-b834-abc382536ee9 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.921828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbd7f9-ae8a-4f74-b834-abc382536ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.922134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbd7f9-ae8a-4f74-b834-abc382536ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.923094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbd7f9-ae8a-4f74-b834-abc382536ee9 None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=0f46cf6eb4a44a71bda92cb212a8009c) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:19.923415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbd7f9-ae8a-4f74-b834-abc382536ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.923828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23dd6-b251-45f2-9e38-a45c20348eb6 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.925141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbd7f9-ae8a-4f74-b834-abc382536ee9 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:19.932727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 351/705] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:19 2022] GET /identity/v3/role_assignments?user.id=0f46cf6eb4a44a71bda92cb212a8009c&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:19.933977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deb65e-88c7-4066-a7fb-1dd55f9b9b21 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.934278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deb65e-88c7-4066-a7fb-1dd55f9b9b21 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.934564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deb65e-88c7-4066-a7fb-1dd55f9b9b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.953774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b1deb65e-88c7-4066-a7fb-1dd55f9b9b21 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:19.954964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b1deb65e-88c7-4066-a7fb-1dd55f9b9b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:19.972500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fc755-6098-4076-b0f5-ac88bbde80b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.974835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fc755-6098-4076-b0f5-ac88bbde80b2 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.975670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fc755-6098-4076-b0f5-ac88bbde80b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.976361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fc755-6098-4076-b0f5-ac88bbde80b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.983215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:19.995647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fc755-6098-4076-b0f5-ac88bbde80b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.997457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fc755-6098-4076-b0f5-ac88bbde80b2 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-110fc755-6098-4076-b0f5-ac88bbde80b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:20.018280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:20.019314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:20.020241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:20.020241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:20.020241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:20.020241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:20.022754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 355/706] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:20.027992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fc755-6098-4076-b0f5-ac88bbde80b2 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:20.045120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 352/707] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:20.069041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1deb65e-88c7-4066-a7fb-1dd55f9b9b21 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:20.168824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fc755-6098-4076-b0f5-ac88bbde80b2 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:20.198985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:20.211788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1deb65e-88c7-4066-a7fb-1dd55f9b9b21 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:20.215212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61aa5-d3f6-454d-b8dd-3cc5abf0bc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:20.215895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61aa5-d3f6-454d-b8dd-3cc5abf0bc31 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:20.216187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61aa5-d3f6-454d-b8dd-3cc5abf0bc31 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:20.216472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61aa5-d3f6-454d-b8dd-3cc5abf0bc31 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:20.217861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61aa5-d3f6-454d-b8dd-3cc5abf0bc31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:20.218234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61aa5-d3f6-454d-b8dd-3cc5abf0bc31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:20.220093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61aa5-d3f6-454d-b8dd-3cc5abf0bc31 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:20.238684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 356/708] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:20.244468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61aa5-d3f6-454d-b8dd-3cc5abf0bc31 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:20.249497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e356d5-6a30-41d8-805b-9f1dfd8eee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:20.250386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e356d5-6a30-41d8-805b-9f1dfd8eee5f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:20.250673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e356d5-6a30-41d8-805b-9f1dfd8eee5f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:20.250951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e356d5-6a30-41d8-805b-9f1dfd8eee5f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:20.251620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e356d5-6a30-41d8-805b-9f1dfd8eee5f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:20.253008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e356d5-6a30-41d8-805b-9f1dfd8eee5f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-d3e356d5-6a30-41d8-805b-9f1dfd8eee5f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:20.269025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:20.270079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:20.270932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 353/709] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jun 30 10:33:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:20.277075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e356d5-6a30-41d8-805b-9f1dfd8eee5f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:20.301112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:20.392832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e356d5-6a30-41d8-805b-9f1dfd8eee5f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:20.431286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029c5ea-0c75-4b25-9966-1f2361d880b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:20.432576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029c5ea-0c75-4b25-9966-1f2361d880b3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:20.432870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029c5ea-0c75-4b25-9966-1f2361d880b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:20.433154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029c5ea-0c75-4b25-9966-1f2361d880b3 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:20.433872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029c5ea-0c75-4b25-9966-1f2361d880b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:20.434247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029c5ea-0c75-4b25-9966-1f2361d880b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:20.435741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029c5ea-0c75-4b25-9966-1f2361d880b3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:20.440913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 354/710] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 10:33:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:20.446404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029c5ea-0c75-4b25-9966-1f2361d880b3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:20.452782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61aa5-d3f6-454d-b8dd-3cc5abf0bc31 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:20.522861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75000db-6927-41ab-ad27-5a7f5945e721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:20.523606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75000db-6927-41ab-ad27-5a7f5945e721 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:20.523895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75000db-6927-41ab-ad27-5a7f5945e721 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:20.524177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75000db-6927-41ab-ad27-5a7f5945e721 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:20.539155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75000db-6927-41ab-ad27-5a7f5945e721 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:20.542457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:20.542902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75000db-6927-41ab-ad27-5a7f5945e721 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:20.557864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029c5ea-0c75-4b25-9966-1f2361d880b3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-e75000db-6927-41ab-ad27-5a7f5945e721 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:20.567021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:20.567940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:20.568866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:20.568866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:20.568866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:20.568866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:20.568866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:20.568866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:20.568866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:20.568866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:20.573015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 357/711] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:20.578231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75000db-6927-41ab-ad27-5a7f5945e721 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:20.621466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5e1ea-f3eb-4119-ba0c-08b2933aac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:20.622633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5e1ea-f3eb-4119-ba0c-08b2933aac35 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:20.623121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5e1ea-f3eb-4119-ba0c-08b2933aac35 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:20.623595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5e1ea-f3eb-4119-ba0c-08b2933aac35 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:20.624520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5e1ea-f3eb-4119-ba0c-08b2933aac35 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:20.625039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5e1ea-f3eb-4119-ba0c-08b2933aac35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:20.627039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5e1ea-f3eb-4119-ba0c-08b2933aac35 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:20.638322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 355/712] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 10:33:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:20.640460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d5bc-9490-46b1-b5d1-f3e0d32736b8 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:20.640986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d5bc-9490-46b1-b5d1-f3e0d32736b8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:20.641461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d5bc-9490-46b1-b5d1-f3e0d32736b8 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:20.643418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 356/713] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:20.647888 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:20.649225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef1cd4-b326-4e30-838b-0d5e5d7b5ed0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:20.652896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef1cd4-b326-4e30-838b-0d5e5d7b5ed0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:20.652896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef1cd4-b326-4e30-838b-0d5e5d7b5ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:20.739079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d6ef1cd4-b326-4e30-838b-0d5e5d7b5ed0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:20.740690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d6ef1cd4-b326-4e30-838b-0d5e5d7b5ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:20.758404 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75000db-6927-41ab-ad27-5a7f5945e721 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:20.791900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18466fa-fe4a-4b71-96ad-62c45fd72317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:20.792418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18466fa-fe4a-4b71-96ad-62c45fd72317 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:20.792708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18466fa-fe4a-4b71-96ad-62c45fd72317 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:20.792991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18466fa-fe4a-4b71-96ad-62c45fd72317 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:20.793799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18466fa-fe4a-4b71-96ad-62c45fd72317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:20.794181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18466fa-fe4a-4b71-96ad-62c45fd72317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:20.795653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18466fa-fe4a-4b71-96ad-62c45fd72317 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:20.810936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 358/714] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:20.817028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18466fa-fe4a-4b71-96ad-62c45fd72317 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:20.878171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 357/715] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:33:20.948782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef1cd4-b326-4e30-838b-0d5e5d7b5ed0 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:20.980992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18466fa-fe4a-4b71-96ad-62c45fd72317 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:20.983910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:21.043326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4768705-da45-4547-83c3-3732baf8e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:21.043900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4768705-da45-4547-83c3-3732baf8e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:21.044182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4768705-da45-4547-83c3-3732baf8e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:21.044454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4768705-da45-4547-83c3-3732baf8e4f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:21.045291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4768705-da45-4547-83c3-3732baf8e4f4 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=f93427bde8154d509bc67675b03903db) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:21.045601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4768705-da45-4547-83c3-3732baf8e4f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:21.047054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4768705-da45-4547-83c3-3732baf8e4f4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:21.060624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 359/716] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:20 2022] GET /identity/v3/role_assignments?user.id=f93427bde8154d509bc67675b03903db&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:21.078655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:21.102838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef1cd4-b326-4e30-838b-0d5e5d7b5ed0 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:21.140108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adebe0-c708-4909-a0ef-91b82df6a694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:21.140911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adebe0-c708-4909-a0ef-91b82df6a694 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:21.141195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adebe0-c708-4909-a0ef-91b82df6a694 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:21.141469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adebe0-c708-4909-a0ef-91b82df6a694 None admin] PATH_INFO: `/v3/services/network` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:21.142159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adebe0-c708-4909-a0ef-91b82df6a694 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:21.143540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adebe0-c708-4909-a0ef-91b82df6a694 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-59adebe0-c708-4909-a0ef-91b82df6a694 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:21.156084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:21.157137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:21.158557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 358/717] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:20 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:21.165582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4768705-da45-4547-83c3-3732baf8e4f4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:21.307048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4768705-da45-4547-83c3-3732baf8e4f4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:21.358665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb53daf-7d37-4d4c-8c4e-ba7739138256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:21.359349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb53daf-7d37-4d4c-8c4e-ba7739138256 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:21.359639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb53daf-7d37-4d4c-8c4e-ba7739138256 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:21.359918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb53daf-7d37-4d4c-8c4e-ba7739138256 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:21.360637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb53daf-7d37-4d4c-8c4e-ba7739138256 None admin] RBAC: Adding query filter params (name=network) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:21.360947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb53daf-7d37-4d4c-8c4e-ba7739138256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:21.362345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb53daf-7d37-4d4c-8c4e-ba7739138256 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:21.369700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 360/718] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:21.377078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adebe0-c708-4909-a0ef-91b82df6a694 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:21.496238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adebe0-c708-4909-a0ef-91b82df6a694 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:21.533520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054b1c0-f07c-49a4-959a-2e71cf31c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:21.534614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054b1c0-f07c-49a4-959a-2e71cf31c0d2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:21.535098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054b1c0-f07c-49a4-959a-2e71cf31c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:21.535587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054b1c0-f07c-49a4-959a-2e71cf31c0d2 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:21.536499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054b1c0-f07c-49a4-959a-2e71cf31c0d2 None admin] RBAC: Adding query filter params (type=network) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:21.537037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054b1c0-f07c-49a4-959a-2e71cf31c0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:21.538639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054b1c0-f07c-49a4-959a-2e71cf31c0d2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:21.549753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 359/719] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:22.216260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82502c1d-7851-4980-b5f6-b38d30aa7b01 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.216611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82502c1d-7851-4980-b5f6-b38d30aa7b01 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.216732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82502c1d-7851-4980-b5f6-b38d30aa7b01 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.218420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 361/720] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:22.230847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff930de-c82f-4d1f-b869-070e67a4450f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.231138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff930de-c82f-4d1f-b869-070e67a4450f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.231422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff930de-c82f-4d1f-b869-070e67a4450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.243537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:22.250566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-bff930de-c82f-4d1f-b869-070e67a4450f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:22.251765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bff930de-c82f-4d1f-b869-070e67a4450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:22.341592 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 360/721] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:22.376676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82502c1d-7851-4980-b5f6-b38d30aa7b01 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:22.412246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863362b-e0e2-48f1-87b8-cb8a84f1615f None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.412584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863362b-e0e2-48f1-87b8-cb8a84f1615f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.412804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863362b-e0e2-48f1-87b8-cb8a84f1615f None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.414417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 361/722] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:22.417853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:22.420021 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df7542-bc7d-4469-8c1b-7ff2d17358d8 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.420313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df7542-bc7d-4469-8c1b-7ff2d17358d8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.420594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df7542-bc7d-4469-8c1b-7ff2d17358d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.446158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-34df7542-bc7d-4469-8c1b-7ff2d17358d8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:22.447378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-34df7542-bc7d-4469-8c1b-7ff2d17358d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:22.516429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 362/723] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:33:22.516960 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82502c1d-7851-4980-b5f6-b38d30aa7b01 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:22.539250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df7542-bc7d-4469-8c1b-7ff2d17358d8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:22.570892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b3435-2c86-481d-a888-f71e8c83ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:22.571694 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b3435-2c86-481d-a888-f71e8c83ba12 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.571983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b3435-2c86-481d-a888-f71e8c83ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.572311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b3435-2c86-481d-a888-f71e8c83ba12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.583178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b3435-2c86-481d-a888-f71e8c83ba12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-ae8b3435-2c86-481d-a888-f71e8c83ba12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:22.590964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:22.592499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:22.593897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 362/724] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:22.606915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b3435-2c86-481d-a888-f71e8c83ba12 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:22.633126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:22.658436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df7542-bc7d-4469-8c1b-7ff2d17358d8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:22.720270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6f997-d314-4b25-a784-07655c284e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:22.721072 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f997-d314-4b25-a784-07655c284e2f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.721459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f997-d314-4b25-a784-07655c284e2f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.721743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f997-d314-4b25-a784-07655c284e2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.724362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:22.735873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b3435-2c86-481d-a888-f71e8c83ba12 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:22.748762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6f997-d314-4b25-a784-07655c284e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-f7d6f997-d314-4b25-a784-07655c284e2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:22.756491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:22.757494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:22.758411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:22.762282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 363/725] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:22.767142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6f997-d314-4b25-a784-07655c284e2f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:22.770060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35df30c-1e6d-4f82-8661-3175f6709901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:22.770734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df30c-1e6d-4f82-8661-3175f6709901 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.771025 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df30c-1e6d-4f82-8661-3175f6709901 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.771309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df30c-1e6d-4f82-8661-3175f6709901 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.772065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df30c-1e6d-4f82-8661-3175f6709901 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:22.772379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df30c-1e6d-4f82-8661-3175f6709901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:22.773876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df30c-1e6d-4f82-8661-3175f6709901 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:22.786061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 363/726] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:22.788760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35df30c-1e6d-4f82-8661-3175f6709901 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:22.891487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35df30c-1e6d-4f82-8661-3175f6709901 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:22.927928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e45f4-0085-43a2-a787-4fdd0e0d6681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:22.928727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e45f4-0085-43a2-a787-4fdd0e0d6681 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.929010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e45f4-0085-43a2-a787-4fdd0e0d6681 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.929288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e45f4-0085-43a2-a787-4fdd0e0d6681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.940697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e45f4-0085-43a2-a787-4fdd0e0d6681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:22.942185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e45f4-0085-43a2-a787-4fdd0e0d6681 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-576e45f4-0085-43a2-a787-4fdd0e0d6681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:22.960664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:22.962188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:22.964549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:22.964549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:22.964549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:22.964549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:22.966484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 364/727] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:22.968994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e45f4-0085-43a2-a787-4fdd0e0d6681 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:22.982406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:22.995255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6f997-d314-4b25-a784-07655c284e2f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.058386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:23.076233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fadfe7-f891-4173-9f5e-114dd30e0b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.076905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fadfe7-f891-4173-9f5e-114dd30e0b7e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.077914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fadfe7-f891-4173-9f5e-114dd30e0b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.077914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fadfe7-f891-4173-9f5e-114dd30e0b7e None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.078245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fadfe7-f891-4173-9f5e-114dd30e0b7e None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:23.078537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fadfe7-f891-4173-9f5e-114dd30e0b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.079931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fadfe7-f891-4173-9f5e-114dd30e0b7e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:23.103584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 364/728] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:23.107966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fadfe7-f891-4173-9f5e-114dd30e0b7e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:23.144452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e45f4-0085-43a2-a787-4fdd0e0d6681 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.181225 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a268eed-86d4-4924-9126-e7921ae1a71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.182802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268eed-86d4-4924-9126-e7921ae1a71c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.183183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268eed-86d4-4924-9126-e7921ae1a71c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.183558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268eed-86d4-4924-9126-e7921ae1a71c None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.184382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a268eed-86d4-4924-9126-e7921ae1a71c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:23.184841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a268eed-86d4-4924-9126-e7921ae1a71c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.186382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a268eed-86d4-4924-9126-e7921ae1a71c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:23.203992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 365/729] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:23.205405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a268eed-86d4-4924-9126-e7921ae1a71c None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:23.284823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:23.307243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fadfe7-f891-4173-9f5e-114dd30e0b7e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.340246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a268eed-86d4-4924-9126-e7921ae1a71c None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.347208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94313a-5eed-4a19-b5ad-91d9aa78df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.349841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94313a-5eed-4a19-b5ad-91d9aa78df67 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.350392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94313a-5eed-4a19-b5ad-91d9aa78df67 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.350965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94313a-5eed-4a19-b5ad-91d9aa78df67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.368444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94313a-5eed-4a19-b5ad-91d9aa78df67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.372911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94313a-5eed-4a19-b5ad-91d9aa78df67 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:23.381891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42deb792-c481-4639-94a1-f10b2eb8606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.382726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb792-c481-4639-94a1-f10b2eb8606e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.383010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb792-c481-4639-94a1-f10b2eb8606e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.383286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb792-c481-4639-94a1-f10b2eb8606e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.392138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42deb792-c481-4639-94a1-f10b2eb8606e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.393850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42deb792-c481-4639-94a1-f10b2eb8606e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-9a94313a-5eed-4a19-b5ad-91d9aa78df67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:23.407473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:23.408429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:23.409331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:23.409331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:23.409331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:23.409331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-42deb792-c481-4639-94a1-f10b2eb8606e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:23.410202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:23.411089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:23.412514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:23.416599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 365/731] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:23.416717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 366/731] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 10:33:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:23.424811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2484c0-2c5b-409a-9a25-36814a014c2e None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.424811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2484c0-2c5b-409a-9a25-36814a014c2e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.424811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2484c0-2c5b-409a-9a25-36814a014c2e None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.424811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 367/732] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:23.424811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2484c0-2c5b-409a-9a25-36814a014c2e None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:23.425219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94313a-5eed-4a19-b5ad-91d9aa78df67 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:23.481230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:23.555526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94313a-5eed-4a19-b5ad-91d9aa78df67 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.555965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2484c0-2c5b-409a-9a25-36814a014c2e None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.586134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:23.600151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efee81-3d61-4c02-9e2f-0c48a68f3588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.600151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efee81-3d61-4c02-9e2f-0c48a68f3588 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.600503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efee81-3d61-4c02-9e2f-0c48a68f3588 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.600705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efee81-3d61-4c02-9e2f-0c48a68f3588 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.601659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efee81-3d61-4c02-9e2f-0c48a68f3588 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:23.601989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efee81-3d61-4c02-9e2f-0c48a68f3588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.602779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356575ca-b1c8-4527-a339-d36b7f3b86a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.604259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356575ca-b1c8-4527-a339-d36b7f3b86a0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.604741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356575ca-b1c8-4527-a339-d36b7f3b86a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.605228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356575ca-b1c8-4527-a339-d36b7f3b86a0 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.605696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efee81-3d61-4c02-9e2f-0c48a68f3588 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:23.606598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356575ca-b1c8-4527-a339-d36b7f3b86a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:23.607118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356575ca-b1c8-4527-a339-d36b7f3b86a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.608872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356575ca-b1c8-4527-a339-d36b7f3b86a0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:23.623128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 366/733] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:23.624690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489008-ffae-4226-a441-cbc48a5c2d5d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.625222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489008-ffae-4226-a441-cbc48a5c2d5d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.625714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489008-ffae-4226-a441-cbc48a5c2d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.632732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 368/734] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 10:33:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:23.632732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efee81-3d61-4c02-9e2f-0c48a68f3588 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:23.651878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f6489008-ffae-4226-a441-cbc48a5c2d5d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:23.653787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f6489008-ffae-4226-a441-cbc48a5c2d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:23.749531 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efee81-3d61-4c02-9e2f-0c48a68f3588 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.751843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 367/735] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:23.753064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489008-ffae-4226-a441-cbc48a5c2d5d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:23.786113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:23.790200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86f9e4-d1aa-4d2e-ad1d-ba0716d47ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.791051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86f9e4-d1aa-4d2e-ad1d-ba0716d47ee1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.791335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86f9e4-d1aa-4d2e-ad1d-ba0716d47ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.791612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86f9e4-d1aa-4d2e-ad1d-ba0716d47ee1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.799316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86f9e4-d1aa-4d2e-ad1d-ba0716d47ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.800779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86f9e4-d1aa-4d2e-ad1d-ba0716d47ee1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-3a86f9e4-d1aa-4d2e-ad1d-ba0716d47ee1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:23.816420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:23.817415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:23.818493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:23.822731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 369/736] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:33:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:23.823550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86f9e4-d1aa-4d2e-ad1d-ba0716d47ee1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:23.867499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:23.871562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489008-ffae-4226-a441-cbc48a5c2d5d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.909747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d596d9-8d91-4b74-b6c2-b46337da7f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.910898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d596d9-8d91-4b74-b6c2-b46337da7f20 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.911324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d596d9-8d91-4b74-b6c2-b46337da7f20 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.911741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d596d9-8d91-4b74-b6c2-b46337da7f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.924302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d596d9-8d91-4b74-b6c2-b46337da7f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.925973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d596d9-8d91-4b74-b6c2-b46337da7f20 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:23.926945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86f9e4-d1aa-4d2e-ad1d-ba0716d47ee1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-60d596d9-8d91-4b74-b6c2-b46337da7f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:23.946189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:23.947347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:23.948444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:23.948444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:23.948444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:23.948444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:23.954613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 368/737] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:23.955863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d596d9-8d91-4b74-b6c2-b46337da7f20 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:23.964603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c40053-fc28-4b79-aa7a-336fc702f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.965268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c40053-fc28-4b79-aa7a-336fc702f72a None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.965551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c40053-fc28-4b79-aa7a-336fc702f72a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.965825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c40053-fc28-4b79-aa7a-336fc702f72a None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.966609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c40053-fc28-4b79-aa7a-336fc702f72a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.967972 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c40053-fc28-4b79-aa7a-336fc702f72a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:24.039818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:24.058100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d596d9-8d91-4b74-b6c2-b46337da7f20 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:24.077974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 370/738] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:33:23 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:24.077974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6f0b9-ae52-4b84-85d8-5e9ef31bb86b None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.077974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6f0b9-ae52-4b84-85d8-5e9ef31bb86b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.077974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6f0b9-ae52-4b84-85d8-5e9ef31bb86b None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.078388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 371/739] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:24.079267 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6f0b9-ae52-4b84-85d8-5e9ef31bb86b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:24.117027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624b5f5-7fd9-4782-8a47-f0d016c38160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:24.117890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b5f5-7fd9-4782-8a47-f0d016c38160 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.118218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b5f5-7fd9-4782-8a47-f0d016c38160 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.118568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b5f5-7fd9-4782-8a47-f0d016c38160 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.120149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624b5f5-7fd9-4782-8a47-f0d016c38160 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:24.120531 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624b5f5-7fd9-4782-8a47-f0d016c38160 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:24.122102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624b5f5-7fd9-4782-8a47-f0d016c38160 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:24.142930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 369/740] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 10:33:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:24.144421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a6b6-3b16-49ab-b4cc-9ddc0ce20213 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.144787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a6b6-3b16-49ab-b4cc-9ddc0ce20213 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.145137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a6b6-3b16-49ab-b4cc-9ddc0ce20213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.166662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3680a6b6-3b16-49ab-b4cc-9ddc0ce20213 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:24.167998 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3680a6b6-3b16-49ab-b4cc-9ddc0ce20213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:24.209631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6f0b9-ae52-4b84-85d8-5e9ef31bb86b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:24.211485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:24.247468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 370/741] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:24.248601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb7350-bb25-4559-8afc-5c2482e64791 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.250166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb7350-bb25-4559-8afc-5c2482e64791 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.250166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb7350-bb25-4559-8afc-5c2482e64791 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.250348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06b5a1-61b0-4e58-b004-68b7aad5f098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:24.250348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b5a1-61b0-4e58-b004-68b7aad5f098 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.250511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b5a1-61b0-4e58-b004-68b7aad5f098 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.250790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b5a1-61b0-4e58-b004-68b7aad5f098 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.250886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 371/742] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:24.251424 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb7350-bb25-4559-8afc-5c2482e64791 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:24.251540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06b5a1-61b0-4e58-b004-68b7aad5f098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:24.251758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06b5a1-61b0-4e58-b004-68b7aad5f098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:24.253126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06b5a1-61b0-4e58-b004-68b7aad5f098 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:24.269827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 372/743] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:24.269827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3620c-9a34-4691-8314-fab562a3061c None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.269827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3620c-9a34-4691-8314-fab562a3061c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.269827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3620c-9a34-4691-8314-fab562a3061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.286928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-93b3620c-9a34-4691-8314-fab562a3061c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:24.288131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-93b3620c-9a34-4691-8314-fab562a3061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:24.332644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:24.359686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 373/744] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:33:24.360955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3620c-9a34-4691-8314-fab562a3061c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:24.381905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb7350-bb25-4559-8afc-5c2482e64791 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:24.419650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e45ac-5f4b-49f9-8f21-5cd0d361885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:24.420581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e45ac-5f4b-49f9-8f21-5cd0d361885d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.420863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e45ac-5f4b-49f9-8f21-5cd0d361885d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.421136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e45ac-5f4b-49f9-8f21-5cd0d361885d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.460308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:24.471571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3620c-9a34-4691-8314-fab562a3061c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:24.499057 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e45ac-5f4b-49f9-8f21-5cd0d361885d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:24.500521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e45ac-5f4b-49f9-8f21-5cd0d361885d None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:24.508260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f3245-c5f3-487d-b3b1-7627cd5d42d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:24.509128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f3245-c5f3-487d-b3b1-7627cd5d42d6 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.509978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f3245-c5f3-487d-b3b1-7627cd5d42d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.510264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f3245-c5f3-487d-b3b1-7627cd5d42d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.520775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f3245-c5f3-487d-b3b1-7627cd5d42d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-a50f3245-c5f3-487d-b3b1-7627cd5d42d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:24.528929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:24.530089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:24.530963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 374/745] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:24.531634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f3245-c5f3-487d-b3b1-7627cd5d42d6 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:24.574147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:24.612752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 372/746] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:33:24.613392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e45ac-5f4b-49f9-8f21-5cd0d361885d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:24.641878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f3245-c5f3-487d-b3b1-7627cd5d42d6 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:24.679891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b794-712a-4c75-adbd-601c2a6d1ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:24.680691 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b794-712a-4c75-adbd-601c2a6d1ac0 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.680977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b794-712a-4c75-adbd-601c2a6d1ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.681287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b794-712a-4c75-adbd-601c2a6d1ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.688959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516b794-712a-4c75-adbd-601c2a6d1ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:24.690445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516b794-712a-4c75-adbd-601c2a6d1ac0 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-5516b794-712a-4c75-adbd-601c2a6d1ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:24.704869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:24.705742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:24.706933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:24.706933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:24.706933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:24.706933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:24.706933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:24.706933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:24.706933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:24.706933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:24.706933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 375/747] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:24.707414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b794-712a-4c75-adbd-601c2a6d1ac0 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:24.724530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:24.727476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e45ac-5f4b-49f9-8f21-5cd0d361885d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:24.763688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e86ee-bb85-4335-8f63-87be59c4cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:24.764357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e86ee-bb85-4335-8f63-87be59c4cdf2 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.764639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e86ee-bb85-4335-8f63-87be59c4cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.764915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e86ee-bb85-4335-8f63-87be59c4cdf2 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.765642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e86ee-bb85-4335-8f63-87be59c4cdf2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:24.767070 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e86ee-bb85-4335-8f63-87be59c4cdf2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:24.813356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b794-712a-4c75-adbd-601c2a6d1ac0 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:24.839164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 373/748] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:33:24 2022] POST /identity/v3/services => generated 240 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:24.840205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e86ee-bb85-4335-8f63-87be59c4cdf2 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:24.876953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b07c05-86d2-46db-9869-789830976dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:24.877736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b07c05-86d2-46db-9869-789830976dc3 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.878110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b07c05-86d2-46db-9869-789830976dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.878396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b07c05-86d2-46db-9869-789830976dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.879181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b07c05-86d2-46db-9869-789830976dc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:24.879496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b07c05-86d2-46db-9869-789830976dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:24.881670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b07c05-86d2-46db-9869-789830976dc3 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:24.893832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 376/749] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:24.897331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b07c05-86d2-46db-9869-789830976dc3 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:24.905456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:24.989645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e86ee-bb85-4335-8f63-87be59c4cdf2 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:24.990814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:25.029863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cee6d7-9fcf-4b06-aa6d-c6df4bb4e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.030713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee6d7-9fcf-4b06-aa6d-c6df4bb4e974 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.030935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b07c05-86d2-46db-9869-789830976dc3 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:25.031060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee6d7-9fcf-4b06-aa6d-c6df4bb4e974 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.031264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee6d7-9fcf-4b06-aa6d-c6df4bb4e974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.043396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cee6d7-9fcf-4b06-aa6d-c6df4bb4e974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.045380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cee6d7-9fcf-4b06-aa6d-c6df4bb4e974 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-01cee6d7-9fcf-4b06-aa6d-c6df4bb4e974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:25.067385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:25.068326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:25.069226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:25.069226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:25.069226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:25.069226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:25.070837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071311-9eb1-4d63-b17d-74eda8990c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.070979 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 374/750] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:25.072846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071311-9eb1-4d63-b17d-74eda8990c16 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.072846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071311-9eb1-4d63-b17d-74eda8990c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.072846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071311-9eb1-4d63-b17d-74eda8990c16 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.073238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cee6d7-9fcf-4b06-aa6d-c6df4bb4e974 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:25.073396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b071311-9eb1-4d63-b17d-74eda8990c16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:25.073653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b071311-9eb1-4d63-b17d-74eda8990c16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.075123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b071311-9eb1-4d63-b17d-74eda8990c16 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:25.088504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 377/751] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:25.089221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071311-9eb1-4d63-b17d-74eda8990c16 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:25.179970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:25.203191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cee6d7-9fcf-4b06-aa6d-c6df4bb4e974 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:25.221020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071311-9eb1-4d63-b17d-74eda8990c16 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:25.254118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0cb8-bc56-4883-bbca-85e2dd40ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.254969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:25.257196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0cb8-bc56-4883-bbca-85e2dd40ec51 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.257756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0cb8-bc56-4883-bbca-85e2dd40ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.258263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0cb8-bc56-4883-bbca-85e2dd40ec51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.260985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e9b0a-6ea6-4854-9f09-8a42807a9141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.261835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e9b0a-6ea6-4854-9f09-8a42807a9141 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.262257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e9b0a-6ea6-4854-9f09-8a42807a9141 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.262719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e9b0a-6ea6-4854-9f09-8a42807a9141 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.263555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e9b0a-6ea6-4854-9f09-8a42807a9141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:25.263994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e9b0a-6ea6-4854-9f09-8a42807a9141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.265482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e9b0a-6ea6-4854-9f09-8a42807a9141 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:25.272199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a0cb8-bc56-4883-bbca-85e2dd40ec51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.274325 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a0cb8-bc56-4883-bbca-85e2dd40ec51 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:25.278594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 378/752] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:25.279522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e9b0a-6ea6-4854-9f09-8a42807a9141 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-4c8a0cb8-bc56-4883-bbca-85e2dd40ec51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:25.297335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:25.298356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:25.299293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:25.299293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:25.299293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:25.299293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:25.302333 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 375/753] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:25.302863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0cb8-bc56-4883-bbca-85e2dd40ec51 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:25.410013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e9b0a-6ea6-4854-9f09-8a42807a9141 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:25.420121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0cb8-bc56-4883-bbca-85e2dd40ec51 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:25.450695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:25.456588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af500b5f-1787-4f34-ae45-fc78bf2dc446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.457546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af500b5f-1787-4f34-ae45-fc78bf2dc446 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.457881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af500b5f-1787-4f34-ae45-fc78bf2dc446 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.458262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af500b5f-1787-4f34-ae45-fc78bf2dc446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.458655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007191c1-f325-4902-afac-800618da642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.459782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007191c1-f325-4902-afac-800618da642b None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.478834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007191c1-f325-4902-afac-800618da642b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.478834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007191c1-f325-4902-afac-800618da642b None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/0f46cf6eb4a44a71bda92cb212a8009c/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.478834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007191c1-f325-4902-afac-800618da642b None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=0f46cf6eb4a44a71bda92cb212a8009c, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.478834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007191c1-f325-4902-afac-800618da642b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:25.479881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af500b5f-1787-4f34-ae45-fc78bf2dc446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.479881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af500b5f-1787-4f34-ae45-fc78bf2dc446 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-af500b5f-1787-4f34-ae45-fc78bf2dc446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:25.481906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:25.483859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 376/754] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:25.486005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af500b5f-1787-4f34-ae45-fc78bf2dc446 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:25.562657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 379/755] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:33:25 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/0f46cf6eb4a44a71bda92cb212a8009c/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:33:25.563936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007191c1-f325-4902-afac-800618da642b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:25.627436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af500b5f-1787-4f34-ae45-fc78bf2dc446 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:25.673647 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1a91f-3f25-48da-908e-c9b2c2c73b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.674795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1a91f-3f25-48da-908e-c9b2c2c73b94 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.675331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1a91f-3f25-48da-908e-c9b2c2c73b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.675832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1a91f-3f25-48da-908e-c9b2c2c73b94 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.676978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1a91f-3f25-48da-908e-c9b2c2c73b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:25.677507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1a91f-3f25-48da-908e-c9b2c2c73b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.679539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1a91f-3f25-48da-908e-c9b2c2c73b94 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:25.694573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 377/756] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:25.695782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:25.711429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1a91f-3f25-48da-908e-c9b2c2c73b94 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:25.758853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007191c1-f325-4902-afac-800618da642b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:25.782972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:25.799710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c6809-26c4-4abc-bd58-de61e2f8809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.803154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6809-26c4-4abc-bd58-de61e2f8809a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.803154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6809-26c4-4abc-bd58-de61e2f8809a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.803154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6809-26c4-4abc-bd58-de61e2f8809a None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.803154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c6809-26c4-4abc-bd58-de61e2f8809a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:25.803154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c6809-26c4-4abc-bd58-de61e2f8809a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.803537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c6809-26c4-4abc-bd58-de61e2f8809a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:25.817155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 380/757] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:25.823030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c6809-26c4-4abc-bd58-de61e2f8809a None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:25.840382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1a91f-3f25-48da-908e-c9b2c2c73b94 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:25.878575 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a9a7-6300-48a6-a4ff-832546b65e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.879830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a9a7-6300-48a6-a4ff-832546b65e50 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.880343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a9a7-6300-48a6-a4ff-832546b65e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.880822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a9a7-6300-48a6-a4ff-832546b65e50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.901432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a9a7-6300-48a6-a4ff-832546b65e50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.903399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a9a7-6300-48a6-a4ff-832546b65e50 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-af64a9a7-6300-48a6-a4ff-832546b65e50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:25.920277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:25.921273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:25.922246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:25.925340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 378/758] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:25.930746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a9a7-6300-48a6-a4ff-832546b65e50 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:25.934975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c6809-26c4-4abc-bd58-de61e2f8809a None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:25.952522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:25.988993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11746-1734-4c5a-97d5-5564ecfaf5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:25.989573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11746-1734-4c5a-97d5-5564ecfaf5a8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:25.989857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11746-1734-4c5a-97d5-5564ecfaf5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:25.990189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11746-1734-4c5a-97d5-5564ecfaf5a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:25.991034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11746-1734-4c5a-97d5-5564ecfaf5a8 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=25df9d4438a34863bbde92da4be8c0df) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:25.991351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11746-1734-4c5a-97d5-5564ecfaf5a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:25.992841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11746-1734-4c5a-97d5-5564ecfaf5a8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:26.003426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 381/759] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:25 2022] GET /identity/v3/role_assignments?user.id=25df9d4438a34863bbde92da4be8c0df&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:26.074524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a9a7-6300-48a6-a4ff-832546b65e50 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:26.085889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:26.112499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54e52d-1376-469b-bda9-1135c0b511cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:26.113346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54e52d-1376-469b-bda9-1135c0b511cb None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:26.113746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54e52d-1376-469b-bda9-1135c0b511cb None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:26.114165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54e52d-1376-469b-bda9-1135c0b511cb None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:26.115205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54e52d-1376-469b-bda9-1135c0b511cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:26.115635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54e52d-1376-469b-bda9-1135c0b511cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:26.117214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54e52d-1376-469b-bda9-1135c0b511cb None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:26.139110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 379/760] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 10:33:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:26.144356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11746-1734-4c5a-97d5-5564ecfaf5a8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:26.272377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11746-1734-4c5a-97d5-5564ecfaf5a8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:26.284344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d45ba-8c67-4fc7-b9b3-5bc1fd7c1046 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:26.286813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d45ba-8c67-4fc7-b9b3-5bc1fd7c1046 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:26.286813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d45ba-8c67-4fc7-b9b3-5bc1fd7c1046 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:26.286990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 380/761] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:26.292177 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ae26-ce7e-4474-acd6-d9fdd2a8f256 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:26.292571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ae26-ce7e-4474-acd6-d9fdd2a8f256 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:26.292954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ae26-ce7e-4474-acd6-d9fdd2a8f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:26.310787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d6a0ae26-ce7e-4474-acd6-d9fdd2a8f256 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:26.312137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d6a0ae26-ce7e-4474-acd6-d9fdd2a8f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:26.314646 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9aec2-8f1f-4e7a-92d6-eb3c7e777539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:26.315315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9aec2-8f1f-4e7a-92d6-eb3c7e777539 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:26.315602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9aec2-8f1f-4e7a-92d6-eb3c7e777539 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:26.315886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9aec2-8f1f-4e7a-92d6-eb3c7e777539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:26.381451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:26.389048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 381/762] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:26.412237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9aec2-8f1f-4e7a-92d6-eb3c7e777539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:26.413764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9aec2-8f1f-4e7a-92d6-eb3c7e777539 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:26.430986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0ae26-ce7e-4474-acd6-d9fdd2a8f256 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:26.527482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 382/763] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:26.529328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9aec2-8f1f-4e7a-92d6-eb3c7e777539 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:26.631995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:26.650376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:26.657640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0ae26-ce7e-4474-acd6-d9fdd2a8f256 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:26.659699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9aec2-8f1f-4e7a-92d6-eb3c7e777539 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:26.699074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa3b9e-c1e4-4627-8867-995c6b7fd46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:26.700041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa3b9e-c1e4-4627-8867-995c6b7fd46e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:26.700430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa3b9e-c1e4-4627-8867-995c6b7fd46e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:26.700814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa3b9e-c1e4-4627-8867-995c6b7fd46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:26.713029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa3b9e-c1e4-4627-8867-995c6b7fd46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:26.714685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa3b9e-c1e4-4627-8867-995c6b7fd46e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-cafa3b9e-c1e4-4627-8867-995c6b7fd46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:26.735089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:26.736202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:26.737283 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:26.737283 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:26.737283 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:26.737283 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:26.739021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 383/764] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:26.746858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa3b9e-c1e4-4627-8867-995c6b7fd46e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:26.758920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9d92-6743-4c7e-93c7-95aae4ef0afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:26.759784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9d92-6743-4c7e-93c7-95aae4ef0afe None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:26.760074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9d92-6743-4c7e-93c7-95aae4ef0afe None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:26.760357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9d92-6743-4c7e-93c7-95aae4ef0afe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:26.761024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a9d92-6743-4c7e-93c7-95aae4ef0afe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:26.762455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a9d92-6743-4c7e-93c7-95aae4ef0afe None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-5d9a9d92-6743-4c7e-93c7-95aae4ef0afe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:26.778520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:26.780137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:26.781922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 382/765] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jun 30 10:33:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:26.786039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9d92-6743-4c7e-93c7-95aae4ef0afe None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:26.922783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa3b9e-c1e4-4627-8867-995c6b7fd46e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:26.950910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:26.964023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a00357-285a-4ec5-9938-70f336fb2b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:26.964701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a00357-285a-4ec5-9938-70f336fb2b43 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:26.964989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a00357-285a-4ec5-9938-70f336fb2b43 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:26.965263 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a00357-285a-4ec5-9938-70f336fb2b43 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:26.967295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a00357-285a-4ec5-9938-70f336fb2b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:26.967615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a00357-285a-4ec5-9938-70f336fb2b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:26.969008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a00357-285a-4ec5-9938-70f336fb2b43 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:26.980504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9d92-6743-4c7e-93c7-95aae4ef0afe None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:26.996024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 384/766] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:27.003236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a00357-285a-4ec5-9938-70f336fb2b43 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:27.049031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488fe98-bfc2-42ca-8d4e-b2875501f4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:27.050954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488fe98-bfc2-42ca-8d4e-b2875501f4aa None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:27.052063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488fe98-bfc2-42ca-8d4e-b2875501f4aa None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:27.052589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488fe98-bfc2-42ca-8d4e-b2875501f4aa None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:27.053661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488fe98-bfc2-42ca-8d4e-b2875501f4aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:27.055248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488fe98-bfc2-42ca-8d4e-b2875501f4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:27.058090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488fe98-bfc2-42ca-8d4e-b2875501f4aa None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:27.071615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 383/767] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 10:33:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:27.074735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488fe98-bfc2-42ca-8d4e-b2875501f4aa None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:27.152122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:27.235898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a00357-285a-4ec5-9938-70f336fb2b43 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:27.292951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488fe98-bfc2-42ca-8d4e-b2875501f4aa None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:27.312704 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dbeed-f849-495f-90aa-30cc5c92f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:27.313877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dbeed-f849-495f-90aa-30cc5c92f2af None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:27.314414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dbeed-f849-495f-90aa-30cc5c92f2af None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:27.314894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dbeed-f849-495f-90aa-30cc5c92f2af None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:27.328307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dbeed-f849-495f-90aa-30cc5c92f2af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:27.330085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dbeed-f849-495f-90aa-30cc5c92f2af None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-d10dbeed-f849-495f-90aa-30cc5c92f2af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:27.356697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:27.357641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:27.358578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:27.358578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:27.358578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:27.358578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:27.358578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:27.358578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:27.358578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:27.358578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:27.371169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 385/768] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:27.375261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dbeed-f849-495f-90aa-30cc5c92f2af None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:27.376664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab211a-355e-4dbb-9075-62a1408ff897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:27.377570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab211a-355e-4dbb-9075-62a1408ff897 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:27.378851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab211a-355e-4dbb-9075-62a1408ff897 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:27.381208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab211a-355e-4dbb-9075-62a1408ff897 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:27.382210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab211a-355e-4dbb-9075-62a1408ff897 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:27.382742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab211a-355e-4dbb-9075-62a1408ff897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:27.389983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab211a-355e-4dbb-9075-62a1408ff897 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:27.401517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 384/769] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 10:33:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:27.403198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e170d3-756c-415a-b557-561cbf49d14c None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:27.403723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e170d3-756c-415a-b557-561cbf49d14c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:27.404209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e170d3-756c-415a-b557-561cbf49d14c None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:27.405711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 385/770] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:27.419397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6026e-578e-44e4-be59-e7b84b278683 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:27.420007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6026e-578e-44e4-be59-e7b84b278683 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:27.420540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6026e-578e-44e4-be59-e7b84b278683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:27.445504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:27.454819 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c6f6026e-578e-44e4-be59-e7b84b278683 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:27.457800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c6f6026e-578e-44e4-be59-e7b84b278683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:27.517968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dbeed-f849-495f-90aa-30cc5c92f2af None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:27.557962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741b3ba-1a32-4278-8d6f-b31026bde881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:27.557962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741b3ba-1a32-4278-8d6f-b31026bde881 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:27.557962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741b3ba-1a32-4278-8d6f-b31026bde881 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:27.557962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741b3ba-1a32-4278-8d6f-b31026bde881 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:27.558762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741b3ba-1a32-4278-8d6f-b31026bde881 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:27.558762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741b3ba-1a32-4278-8d6f-b31026bde881 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:27.558762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741b3ba-1a32-4278-8d6f-b31026bde881 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:27.574042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 386/771] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:27.577487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741b3ba-1a32-4278-8d6f-b31026bde881 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:27.650714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 386/772] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:27.651616 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6026e-578e-44e4-be59-e7b84b278683 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:27.688896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:27.720305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741b3ba-1a32-4278-8d6f-b31026bde881 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:27.728406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:27.756523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04f16-bce9-4937-910c-9bd50ac60f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:27.757090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04f16-bce9-4937-910c-9bd50ac60f0e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:27.757381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04f16-bce9-4937-910c-9bd50ac60f0e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:27.757661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04f16-bce9-4937-910c-9bd50ac60f0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:27.758493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f04f16-bce9-4937-910c-9bd50ac60f0e None admin] RBAC: Adding query filter params (interface=public, service_id=1b5dc717a7e6405aaf4422ed297d0a36, region_id=RegionOne) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:27.759876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f04f16-bce9-4937-910c-9bd50ac60f0e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:27.761273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f04f16-bce9-4937-910c-9bd50ac60f0e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:27.770186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 387/773] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 10:33:27 2022] GET /identity/v3/endpoints?service_id=1b5dc717a7e6405aaf4422ed297d0a36&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:27.771206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04f16-bce9-4937-910c-9bd50ac60f0e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:27.785403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6026e-578e-44e4-be59-e7b84b278683 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:27.824364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73ded7-9d96-4eb1-9e17-75376b4a042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:27.825324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73ded7-9d96-4eb1-9e17-75376b4a042b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:27.825854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73ded7-9d96-4eb1-9e17-75376b4a042b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:27.826351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73ded7-9d96-4eb1-9e17-75376b4a042b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:27.827467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73ded7-9d96-4eb1-9e17-75376b4a042b None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=f93427bde8154d509bc67675b03903db) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:27.827967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73ded7-9d96-4eb1-9e17-75376b4a042b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:27.829696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73ded7-9d96-4eb1-9e17-75376b4a042b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:27.836436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 387/774] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:27 2022] GET /identity/v3/role_assignments?user.id=f93427bde8154d509bc67675b03903db&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:27.838041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73ded7-9d96-4eb1-9e17-75376b4a042b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:27.879794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04f16-bce9-4937-910c-9bd50ac60f0e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:27.918504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323208-52c7-4f53-95f1-d11219edc5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:27.919309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323208-52c7-4f53-95f1-d11219edc5d4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:27.919597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323208-52c7-4f53-95f1-d11219edc5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:27.919876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323208-52c7-4f53-95f1-d11219edc5d4 None admin] PATH_INFO: `/v3/services/network` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:27.920576 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323208-52c7-4f53-95f1-d11219edc5d4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:27.921923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323208-52c7-4f53-95f1-d11219edc5d4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-3f323208-52c7-4f53-95f1-d11219edc5d4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:27.937470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:27.938564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:27.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 388/775] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:27 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:27.951096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323208-52c7-4f53-95f1-d11219edc5d4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:27.953464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:27.984182 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73ded7-9d96-4eb1-9e17-75376b4a042b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:28.026536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:28.070138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574493f-cf4d-4bc7-9f66-e875c1081010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:28.070821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574493f-cf4d-4bc7-9f66-e875c1081010 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.071109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574493f-cf4d-4bc7-9f66-e875c1081010 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.071386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574493f-cf4d-4bc7-9f66-e875c1081010 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.072649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574493f-cf4d-4bc7-9f66-e875c1081010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:28.074085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574493f-cf4d-4bc7-9f66-e875c1081010 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:28.080915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 388/776] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 10:33:27 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:28.082187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d345ef2-1783-4d19-9b1f-8fe4c12c7b18 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.082474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d345ef2-1783-4d19-9b1f-8fe4c12c7b18 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.082752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d345ef2-1783-4d19-9b1f-8fe4c12c7b18 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.084330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 389/777] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:28.092561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c5f0c-2abf-4033-abe4-a752a2159126 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.092561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c5f0c-2abf-4033-abe4-a752a2159126 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.092561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c5f0c-2abf-4033-abe4-a752a2159126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.113729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a47c5f0c-2abf-4033-abe4-a752a2159126 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:28.114376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323208-52c7-4f53-95f1-d11219edc5d4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:28.115160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a47c5f0c-2abf-4033-abe4-a752a2159126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:28.158350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc9cf-d8b7-40d9-ad73-f67670ca006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:28.159507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc9cf-d8b7-40d9-ad73-f67670ca006b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.160327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc9cf-d8b7-40d9-ad73-f67670ca006b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.160897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc9cf-d8b7-40d9-ad73-f67670ca006b None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.161902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cc9cf-d8b7-40d9-ad73-f67670ca006b None admin] RBAC: Adding query filter params (name=network) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:28.162421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cc9cf-d8b7-40d9-ad73-f67670ca006b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:28.164022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cc9cf-d8b7-40d9-ad73-f67670ca006b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:28.171370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 389/778] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:28.184757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc9cf-d8b7-40d9-ad73-f67670ca006b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:28.234123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 390/779] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:28.293158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c5f0c-2abf-4033-abe4-a752a2159126 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:28.348571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:28.354145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc9cf-d8b7-40d9-ad73-f67670ca006b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:28.391046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade37a-d158-44d8-bf91-54b62c37b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:28.392153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade37a-d158-44d8-bf91-54b62c37b5b4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.392274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade37a-d158-44d8-bf91-54b62c37b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.392627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade37a-d158-44d8-bf91-54b62c37b5b4 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.393423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ade37a-d158-44d8-bf91-54b62c37b5b4 None admin] RBAC: Adding query filter params (type=network) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:28.393809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ade37a-d158-44d8-bf91-54b62c37b5b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:28.394330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:28.395359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ade37a-d158-44d8-bf91-54b62c37b5b4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:28.403134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 390/780] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:28.409975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade37a-d158-44d8-bf91-54b62c37b5b4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:28.426545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c5f0c-2abf-4033-abe4-a752a2159126 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:28.474189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548f141-427e-4478-b3f0-382a27d2897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:28.474995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548f141-427e-4478-b3f0-382a27d2897c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.475287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548f141-427e-4478-b3f0-382a27d2897c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.475566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548f141-427e-4478-b3f0-382a27d2897c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.500084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548f141-427e-4478-b3f0-382a27d2897c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-0548f141-427e-4478-b3f0-382a27d2897c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:28.507992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:28.509174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:28.510240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:28.512623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 391/781] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:28.514162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22a982-d2cc-4b8c-8534-b27042b5e729 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.514602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22a982-d2cc-4b8c-8534-b27042b5e729 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.515038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22a982-d2cc-4b8c-8534-b27042b5e729 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.520587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 392/782] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:28.521547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22a982-d2cc-4b8c-8534-b27042b5e729 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:28.563053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade37a-d158-44d8-bf91-54b62c37b5b4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:28.607618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7093da-edbf-4b76-9cb3-47fcda85775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:28.608257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7093da-edbf-4b76-9cb3-47fcda85775a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.608574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7093da-edbf-4b76-9cb3-47fcda85775a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.608896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7093da-edbf-4b76-9cb3-47fcda85775a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.609696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7093da-edbf-4b76-9cb3-47fcda85775a None admin] RBAC: Adding query filter params (interface=public, service_id=c2d45544661241dbb7b723c072ef8b52, region_id=RegionOne) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:28.610043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7093da-edbf-4b76-9cb3-47fcda85775a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:28.611423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7093da-edbf-4b76-9cb3-47fcda85775a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:28.622013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 391/783] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 10:33:28 2022] GET /identity/v3/endpoints?service_id=c2d45544661241dbb7b723c072ef8b52&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:28.623681 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceada2b-fd87-489e-9e2c-3cbeeca730e9 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.624241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceada2b-fd87-489e-9e2c-3cbeeca730e9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.624526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceada2b-fd87-489e-9e2c-3cbeeca730e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.647660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-eceada2b-fd87-489e-9e2c-3cbeeca730e9 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:28.649481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-eceada2b-fd87-489e-9e2c-3cbeeca730e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:28.650899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22a982-d2cc-4b8c-8534-b27042b5e729 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:28.681842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:28.693463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02959def-34df-4a09-afe4-ad7335cd192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:28.694567 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02959def-34df-4a09-afe4-ad7335cd192a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.694928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02959def-34df-4a09-afe4-ad7335cd192a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.695519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02959def-34df-4a09-afe4-ad7335cd192a None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.696347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02959def-34df-4a09-afe4-ad7335cd192a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:28.696771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02959def-34df-4a09-afe4-ad7335cd192a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:28.698243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02959def-34df-4a09-afe4-ad7335cd192a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:28.705487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:28.710113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 393/784] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:28.711618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02959def-34df-4a09-afe4-ad7335cd192a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:28.748516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 392/785] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:28.750280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceada2b-fd87-489e-9e2c-3cbeeca730e9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:28.838225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02959def-34df-4a09-afe4-ad7335cd192a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:28.875160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d08b-e050-4c70-8667-17cf51ad9019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:28.875825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d08b-e050-4c70-8667-17cf51ad9019 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.876114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d08b-e050-4c70-8667-17cf51ad9019 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.876496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d08b-e050-4c70-8667-17cf51ad9019 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.877279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d08b-e050-4c70-8667-17cf51ad9019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:28.878688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d08b-e050-4c70-8667-17cf51ad9019 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:28.879892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceada2b-fd87-489e-9e2c-3cbeeca730e9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:28.884528 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 394/786] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 10:33:28 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:28.885359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d08b-e050-4c70-8667-17cf51ad9019 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:28.917373 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17f7a2-1b49-47b1-bf6e-0729ac29415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:28.918242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17f7a2-1b49-47b1-bf6e-0729ac29415f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:28.918528 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17f7a2-1b49-47b1-bf6e-0729ac29415f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:28.918806 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17f7a2-1b49-47b1-bf6e-0729ac29415f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:28.930337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17f7a2-1b49-47b1-bf6e-0729ac29415f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:28.931979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17f7a2-1b49-47b1-bf6e-0729ac29415f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-aa17f7a2-1b49-47b1-bf6e-0729ac29415f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:28.951912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:28.952879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:28.953769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:28.953769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:28.953769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:28.953769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:28.957877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 393/787] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:28.959259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17f7a2-1b49-47b1-bf6e-0729ac29415f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:28.971675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:28.977434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:29.019547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d08b-e050-4c70-8667-17cf51ad9019 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:29.058397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481e212-53bf-468a-a400-ffecf60a5dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:29.059385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e212-53bf-468a-a400-ffecf60a5dd2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:29.059774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e212-53bf-468a-a400-ffecf60a5dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:29.060186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e212-53bf-468a-a400-ffecf60a5dd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:29.071462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481e212-53bf-468a-a400-ffecf60a5dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:29.076259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17f7a2-1b49-47b1-bf6e-0729ac29415f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-6481e212-53bf-468a-a400-ffecf60a5dd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:29.080435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:29.081613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:29.082756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 395/788] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:29.089325 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481e212-53bf-468a-a400-ffecf60a5dd2 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:29.122512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c619f3-eca6-4cc9-9435-c6491799c8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:29.123509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c619f3-eca6-4cc9-9435-c6491799c8d8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:29.124073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c619f3-eca6-4cc9-9435-c6491799c8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:29.124558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c619f3-eca6-4cc9-9435-c6491799c8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:29.125660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c619f3-eca6-4cc9-9435-c6491799c8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:29.126181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c619f3-eca6-4cc9-9435-c6491799c8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:29.127899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c619f3-eca6-4cc9-9435-c6491799c8d8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:29.146138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 394/789] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:29.148141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c619f3-eca6-4cc9-9435-c6491799c8d8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:29.206165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481e212-53bf-468a-a400-ffecf60a5dd2 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:29.222746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:29.232981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:29.245471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ca72b-5775-412b-a1a9-c2a7874507a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:29.246175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca72b-5775-412b-a1a9-c2a7874507a7 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:29.256769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca72b-5775-412b-a1a9-c2a7874507a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:29.256769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca72b-5775-412b-a1a9-c2a7874507a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:29.256769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ca72b-5775-412b-a1a9-c2a7874507a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:29.256769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ca72b-5775-412b-a1a9-c2a7874507a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:29.256769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ca72b-5775-412b-a1a9-c2a7874507a7 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:29.258381 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 396/790] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:29.261174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c619f3-eca6-4cc9-9435-c6491799c8d8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:29.266075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ca72b-5775-412b-a1a9-c2a7874507a7 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:29.301671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0323257-2df3-4e8a-a386-d5b6f209ee4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:29.303393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323257-2df3-4e8a-a386-d5b6f209ee4e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:29.303962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323257-2df3-4e8a-a386-d5b6f209ee4e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:29.304387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323257-2df3-4e8a-a386-d5b6f209ee4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:29.312568 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0323257-2df3-4e8a-a386-d5b6f209ee4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:29.314317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0323257-2df3-4e8a-a386-d5b6f209ee4e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-d0323257-2df3-4e8a-a386-d5b6f209ee4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:29.330816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:29.331851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:29.332926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:29.340382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 395/791] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 10:33:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:29.341737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0323257-2df3-4e8a-a386-d5b6f209ee4e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:29.382528 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ca72b-5775-412b-a1a9-c2a7874507a7 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:29.449328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0323257-2df3-4e8a-a386-d5b6f209ee4e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:29.458653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165c2aa-ff1d-46e1-a65c-9de20c4f6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:29.459531 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165c2aa-ff1d-46e1-a65c-9de20c4f6d26 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:29.459822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165c2aa-ff1d-46e1-a65c-9de20c4f6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:29.460099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165c2aa-ff1d-46e1-a65c-9de20c4f6d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:29.478987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:29.484050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165c2aa-ff1d-46e1-a65c-9de20c4f6d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:29.485493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165c2aa-ff1d-46e1-a65c-9de20c4f6d26 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:29.488421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6df5c-aa89-4f5c-8896-7b5e035579de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:29.489350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6df5c-aa89-4f5c-8896-7b5e035579de None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:29.489833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6df5c-aa89-4f5c-8896-7b5e035579de None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:29.490447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6df5c-aa89-4f5c-8896-7b5e035579de None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:29.491590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6df5c-aa89-4f5c-8896-7b5e035579de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:29.492100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6df5c-aa89-4f5c-8896-7b5e035579de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:29.494560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6df5c-aa89-4f5c-8896-7b5e035579de None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-2165c2aa-ff1d-46e1-a65c-9de20c4f6d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:29.517702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:29.518678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:29.520169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:29.520169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:29.520169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:29.520169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:29.520169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 397/793] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:29.520594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 396/793] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 10:33:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:29.523012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165c2aa-ff1d-46e1-a65c-9de20c4f6d26 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:29.524637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6df5c-aa89-4f5c-8896-7b5e035579de None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:29.607925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:29.645790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6df5c-aa89-4f5c-8896-7b5e035579de None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:29.685182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73510efc-4831-4c66-9240-438fd2453fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:29.686430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73510efc-4831-4c66-9240-438fd2453fae None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:29.686941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73510efc-4831-4c66-9240-438fd2453fae None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:29.687414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73510efc-4831-4c66-9240-438fd2453fae None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:29.688556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73510efc-4831-4c66-9240-438fd2453fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:29.689147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73510efc-4831-4c66-9240-438fd2453fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:29.690742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73510efc-4831-4c66-9240-438fd2453fae None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:29.704479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 397/794] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:29.716357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73510efc-4831-4c66-9240-438fd2453fae None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:29.721212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165c2aa-ff1d-46e1-a65c-9de20c4f6d26 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:29.766569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:29.791574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a0455-8f44-4761-af54-453207188cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:29.792338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a0455-8f44-4761-af54-453207188cd0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:29.792626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a0455-8f44-4761-af54-453207188cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:29.792907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a0455-8f44-4761-af54-453207188cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:29.825435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73510efc-4831-4c66-9240-438fd2453fae None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:29.861394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115fe33-c170-4a56-88f4-e256e2fa59f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:29.862589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115fe33-c170-4a56-88f4-e256e2fa59f9 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:29.863092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115fe33-c170-4a56-88f4-e256e2fa59f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:29.863569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115fe33-c170-4a56-88f4-e256e2fa59f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:29.872185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115fe33-c170-4a56-88f4-e256e2fa59f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:29.873872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115fe33-c170-4a56-88f4-e256e2fa59f9 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-5115fe33-c170-4a56-88f4-e256e2fa59f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:29.889177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:29.890157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:29.891090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:29.893974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 398/795] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:33:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:29.906943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115fe33-c170-4a56-88f4-e256e2fa59f9 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:29.924695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a0455-8f44-4761-af54-453207188cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:29.927029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a0455-8f44-4761-af54-453207188cd0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:29.974749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:30.057910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115fe33-c170-4a56-88f4-e256e2fa59f9 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:30.078599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:30.092576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 398/796] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:33:30.094359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a0455-8f44-4761-af54-453207188cd0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:30.146650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb7db-2d22-412a-934a-54e589537ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:30.147346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb7db-2d22-412a-934a-54e589537ff3 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.147640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb7db-2d22-412a-934a-54e589537ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.147928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb7db-2d22-412a-934a-54e589537ff3 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.148787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb7db-2d22-412a-934a-54e589537ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:30.149104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb7db-2d22-412a-934a-54e589537ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:30.150623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb7db-2d22-412a-934a-54e589537ff3 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:30.168884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 399/797] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 10:33:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:30.178896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb7db-2d22-412a-934a-54e589537ff3 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:30.228955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a0455-8f44-4761-af54-453207188cd0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:30.266555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08d7d-be5b-4a13-88df-2801e4d76a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:30.267711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08d7d-be5b-4a13-88df-2801e4d76a11 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.268191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08d7d-be5b-4a13-88df-2801e4d76a11 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.268658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08d7d-be5b-4a13-88df-2801e4d76a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.276064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:30.280896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe08d7d-be5b-4a13-88df-2801e4d76a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:30.282609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe08d7d-be5b-4a13-88df-2801e4d76a11 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-bbe08d7d-be5b-4a13-88df-2801e4d76a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:30.301016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:30.301976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:30.302874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:30.302874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:30.302874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:30.302874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:30.310001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 399/798] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:30.311474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08d7d-be5b-4a13-88df-2801e4d76a11 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:30.400099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb7db-2d22-412a-934a-54e589537ff3 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:30.419602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08d7d-be5b-4a13-88df-2801e4d76a11 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:30.440095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68605b-176f-4fb2-a508-3352551ed843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:30.440896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68605b-176f-4fb2-a508-3352551ed843 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.441182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68605b-176f-4fb2-a508-3352551ed843 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.441461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68605b-176f-4fb2-a508-3352551ed843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.452958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68605b-176f-4fb2-a508-3352551ed843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:30.454471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68605b-176f-4fb2-a508-3352551ed843 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:30.456723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4aadd-f4db-4fdf-b1ee-366a1e749434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:30.457562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4aadd-f4db-4fdf-b1ee-366a1e749434 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.458044 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4aadd-f4db-4fdf-b1ee-366a1e749434 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.458492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4aadd-f4db-4fdf-b1ee-366a1e749434 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.459366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4aadd-f4db-4fdf-b1ee-366a1e749434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:30.459850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4aadd-f4db-4fdf-b1ee-366a1e749434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:30.461373 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4aadd-f4db-4fdf-b1ee-366a1e749434 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-ee68605b-176f-4fb2-a508-3352551ed843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:30.473732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:30.474902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:30.476011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:30.476011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:30.476011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:30.476011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:30.477194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 400/800] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:30.478579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 400/800] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:30.479508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4951f-37b5-49cb-9b9d-8c4e0828253e None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.479992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4951f-37b5-49cb-9b9d-8c4e0828253e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.480457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4951f-37b5-49cb-9b9d-8c4e0828253e None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.481264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68605b-176f-4fb2-a508-3352551ed843 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:30.482179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 401/801] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:30.483310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4951f-37b5-49cb-9b9d-8c4e0828253e None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:30.506424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:30.540863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:30.595400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4951f-37b5-49cb-9b9d-8c4e0828253e None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:30.599957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68605b-176f-4fb2-a508-3352551ed843 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:30.633092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4598e3d-1dfb-4007-8f9b-359abf4b5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:30.633912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598e3d-1dfb-4007-8f9b-359abf4b5044 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.634741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598e3d-1dfb-4007-8f9b-359abf4b5044 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.634981 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7b1a-171d-44b4-9d9e-77ba124c921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:30.635115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598e3d-1dfb-4007-8f9b-359abf4b5044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.635644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7b1a-171d-44b4-9d9e-77ba124c921d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.635934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7b1a-171d-44b4-9d9e-77ba124c921d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.636214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7b1a-171d-44b4-9d9e-77ba124c921d None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.636946 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7b1a-171d-44b4-9d9e-77ba124c921d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:30.637258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7b1a-171d-44b4-9d9e-77ba124c921d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:30.638723 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7b1a-171d-44b4-9d9e-77ba124c921d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:30.643064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598e3d-1dfb-4007-8f9b-359abf4b5044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:30.644667 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598e3d-1dfb-4007-8f9b-359abf4b5044 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:30.655353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 401/802] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:30.655353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394d40b-46ab-4538-8500-16beb0967d48 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.655353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394d40b-46ab-4538-8500-16beb0967d48 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.655353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394d40b-46ab-4538-8500-16beb0967d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-a4598e3d-1dfb-4007-8f9b-359abf4b5044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:30.660650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:30.661639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:30.662566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:30.662566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:30.662566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:30.662566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:30.662566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:30.662566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:30.662566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:30.662566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:30.662566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 402/803] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:30.663524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f8b5a-31d9-42de-b828-7ab7777f0bd6 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.663751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f8b5a-31d9-42de-b828-7ab7777f0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.664034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f8b5a-31d9-42de-b828-7ab7777f0bd6 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.666853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 403/804] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:30.666853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f8b5a-31d9-42de-b828-7ab7777f0bd6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:30.671431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1394d40b-46ab-4538-8500-16beb0967d48 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:30.672553 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1394d40b-46ab-4538-8500-16beb0967d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:30.741799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 402/805] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:30.742570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394d40b-46ab-4538-8500-16beb0967d48 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:30.750691 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:30.794158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f8b5a-31d9-42de-b828-7ab7777f0bd6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:30.808564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:30.835806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa8079-0756-45d7-9b3b-9bffc15d7455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:30.836601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8079-0756-45d7-9b3b-9bffc15d7455 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.836976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8079-0756-45d7-9b3b-9bffc15d7455 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.837803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8079-0756-45d7-9b3b-9bffc15d7455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.841134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394d40b-46ab-4538-8500-16beb0967d48 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:30.844942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa8079-0756-45d7-9b3b-9bffc15d7455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:30.847033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa8079-0756-45d7-9b3b-9bffc15d7455 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-d5fa8079-0756-45d7-9b3b-9bffc15d7455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:30.862885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:30.863964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:30.864946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:30.864946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:30.864946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:30.864946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:30.864946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:30.864946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:30.864946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:30.864946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:30.864946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 404/806] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:30.865737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0136-8f5c-4fc8-8ff0-2f4d669b9a9f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.866387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0136-8f5c-4fc8-8ff0-2f4d669b9a9f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.866387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0136-8f5c-4fc8-8ff0-2f4d669b9a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.881406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e008ec3-4226-43b2-b8c4-2fa27e1b7b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:30.882095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e008ec3-4226-43b2-b8c4-2fa27e1b7b31 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:30.882383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e008ec3-4226-43b2-b8c4-2fa27e1b7b31 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:30.882659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e008ec3-4226-43b2-b8c4-2fa27e1b7b31 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:30.883476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e008ec3-4226-43b2-b8c4-2fa27e1b7b31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:30.883641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-eaec0136-8f5c-4fc8-8ff0-2f4d669b9a9f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:30.883828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e008ec3-4226-43b2-b8c4-2fa27e1b7b31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:30.885472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-eaec0136-8f5c-4fc8-8ff0-2f4d669b9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:30.885852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e008ec3-4226-43b2-b8c4-2fa27e1b7b31 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:30.906726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 403/807] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:30.907699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e008ec3-4226-43b2-b8c4-2fa27e1b7b31 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:30.959723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 405/808] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:30.967293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec0136-8f5c-4fc8-8ff0-2f4d669b9a9f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:30.979329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:31.014724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e008ec3-4226-43b2-b8c4-2fa27e1b7b31 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.048694 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1818e-75ec-461b-b9cf-e93233b2de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.049491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1818e-75ec-461b-b9cf-e93233b2de5d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.049784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1818e-75ec-461b-b9cf-e93233b2de5d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.050098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1818e-75ec-461b-b9cf-e93233b2de5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.061455 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1818e-75ec-461b-b9cf-e93233b2de5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-75d1818e-75ec-461b-b9cf-e93233b2de5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:31.069061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:31.070175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 404/809] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:31.071099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1818e-75ec-461b-b9cf-e93233b2de5d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:31.086402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:31.089309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec0136-8f5c-4fc8-8ff0-2f4d669b9a9f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.127557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186b6c2-022d-44f0-ace3-81c120649344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.128229 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186b6c2-022d-44f0-ace3-81c120649344 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.128513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186b6c2-022d-44f0-ace3-81c120649344 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.128790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186b6c2-022d-44f0-ace3-81c120649344 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.129578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186b6c2-022d-44f0-ace3-81c120649344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:31.129893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186b6c2-022d-44f0-ace3-81c120649344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:31.131357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186b6c2-022d-44f0-ace3-81c120649344 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:31.145102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 406/810] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:31.150330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186b6c2-022d-44f0-ace3-81c120649344 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:31.192591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1818e-75ec-461b-b9cf-e93233b2de5d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.223500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:31.233330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f3109-3c06-4810-8b39-b8f83f7591d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.234010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f3109-3c06-4810-8b39-b8f83f7591d3 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.234300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f3109-3c06-4810-8b39-b8f83f7591d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.236103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f3109-3c06-4810-8b39-b8f83f7591d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.236103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f3109-3c06-4810-8b39-b8f83f7591d3 None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=0f46cf6eb4a44a71bda92cb212a8009c) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:31.236103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f3109-3c06-4810-8b39-b8f83f7591d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:31.237233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f3109-3c06-4810-8b39-b8f83f7591d3 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:31.253975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 405/811] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:31 2022] GET /identity/v3/role_assignments?user.id=0f46cf6eb4a44a71bda92cb212a8009c&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:31.253975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f3109-3c06-4810-8b39-b8f83f7591d3 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:31.271247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186b6c2-022d-44f0-ace3-81c120649344 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.314114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571d116-9045-450c-b5cc-a62a669fa21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.315128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571d116-9045-450c-b5cc-a62a669fa21a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.315419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571d116-9045-450c-b5cc-a62a669fa21a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.315697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571d116-9045-450c-b5cc-a62a669fa21a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.316364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571d116-9045-450c-b5cc-a62a669fa21a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:31.317788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571d116-9045-450c-b5cc-a62a669fa21a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-2571d116-9045-450c-b5cc-a62a669fa21a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:31.331694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:31.332899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:31.333873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 407/812] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jun 30 10:33:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:31.335212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571d116-9045-450c-b5cc-a62a669fa21a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:31.364232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:31.371522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f3109-3c06-4810-8b39-b8f83f7591d3 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.409513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c498cd-1056-4d60-88c6-f9845600f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.410475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c498cd-1056-4d60-88c6-f9845600f125 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.410763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c498cd-1056-4d60-88c6-f9845600f125 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.411451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c498cd-1056-4d60-88c6-f9845600f125 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.411872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c498cd-1056-4d60-88c6-f9845600f125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:31.412361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c498cd-1056-4d60-88c6-f9845600f125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:31.414621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c498cd-1056-4d60-88c6-f9845600f125 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:31.424806 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 406/813] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:31.425750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c498cd-1056-4d60-88c6-f9845600f125 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:31.454106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571d116-9045-450c-b5cc-a62a669fa21a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.485079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:31.496801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1936d1-d975-4be3-b817-09ae22a9dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.497756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1936d1-d975-4be3-b817-09ae22a9dac5 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.498343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1936d1-d975-4be3-b817-09ae22a9dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.498516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1936d1-d975-4be3-b817-09ae22a9dac5 None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/25df9d4438a34863bbde92da4be8c0df/roles/449d76dce6534ca9b28d0a003483d951` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.514845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1936d1-d975-4be3-b817-09ae22a9dac5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=25df9d4438a34863bbde92da4be8c0df, role_id=449d76dce6534ca9b28d0a003483d951)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:31.516478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1936d1-d975-4be3-b817-09ae22a9dac5 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:31.534788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c498cd-1056-4d60-88c6-f9845600f125 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.568871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8e41d-0e8d-4521-80bb-3be275796069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.569534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8e41d-0e8d-4521-80bb-3be275796069 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.569820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8e41d-0e8d-4521-80bb-3be275796069 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.570135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8e41d-0e8d-4521-80bb-3be275796069 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.570849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8e41d-0e8d-4521-80bb-3be275796069 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:31.576254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8e41d-0e8d-4521-80bb-3be275796069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:31.576254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8e41d-0e8d-4521-80bb-3be275796069 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:31.577785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 407/814] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 10:33:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:31.578479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8e41d-0e8d-4521-80bb-3be275796069 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:31.595063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 408/815] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:33:31 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/25df9d4438a34863bbde92da4be8c0df/roles/449d76dce6534ca9b28d0a003483d951 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:33:31.596807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a02b9-8f48-42ac-ab67-29a996754c49 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.602153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a02b9-8f48-42ac-ab67-29a996754c49 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.602153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a02b9-8f48-42ac-ab67-29a996754c49 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.602153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 409/816] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:31.602153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a02b9-8f48-42ac-ab67-29a996754c49 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:31.702540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8e41d-0e8d-4521-80bb-3be275796069 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.714354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:31.721229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:31.741389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df444332-ff7f-41f7-a780-de52c2dfb26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.742550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444332-ff7f-41f7-a780-de52c2dfb26c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.742990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444332-ff7f-41f7-a780-de52c2dfb26c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.744073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444332-ff7f-41f7-a780-de52c2dfb26c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.753232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a02b9-8f48-42ac-ab67-29a996754c49 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.756637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df444332-ff7f-41f7-a780-de52c2dfb26c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:31.758047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df444332-ff7f-41f7-a780-de52c2dfb26c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-df444332-ff7f-41f7-a780-de52c2dfb26c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:31.781570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:31.784902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:31.785787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:31.785787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:31.785787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:31.785787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:31.785787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 408/817] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:31.785787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb3517-b6e6-4709-899b-ceceb72dd880 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.785787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb3517-b6e6-4709-899b-ceceb72dd880 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.785787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb3517-b6e6-4709-899b-ceceb72dd880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.808391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-38fb3517-b6e6-4709-899b-ceceb72dd880 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:31.809137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-38fb3517-b6e6-4709-899b-ceceb72dd880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:31.812379 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54463e-be79-4b63-ad01-20749a8d2f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.814232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54463e-be79-4b63-ad01-20749a8d2f98 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.814693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54463e-be79-4b63-ad01-20749a8d2f98 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:31.815130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54463e-be79-4b63-ad01-20749a8d2f98 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:31.815990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54463e-be79-4b63-ad01-20749a8d2f98 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:31.816443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54463e-be79-4b63-ad01-20749a8d2f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:31.818000 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54463e-be79-4b63-ad01-20749a8d2f98 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:31.826816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 410/818] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jun 30 10:33:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:31.828255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54463e-be79-4b63-ad01-20749a8d2f98 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:31.896599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 409/819] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:31.897650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb3517-b6e6-4709-899b-ceceb72dd880 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:31.961300 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54463e-be79-4b63-ad01-20749a8d2f98 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:31.998330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bcbd1-1da7-469b-8c9c-c7a716d70825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:31.999239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bcbd1-1da7-469b-8c9c-c7a716d70825 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:31.999670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bcbd1-1da7-469b-8c9c-c7a716d70825 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:32.000093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bcbd1-1da7-469b-8c9c-c7a716d70825 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:32.001010 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bcbd1-1da7-469b-8c9c-c7a716d70825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:32.001472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bcbd1-1da7-469b-8c9c-c7a716d70825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:32.003016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bcbd1-1da7-469b-8c9c-c7a716d70825 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:32.010049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:32.013279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:32.020168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 411/820] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:32.020168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bcbd1-1da7-469b-8c9c-c7a716d70825 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:32.022060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb3517-b6e6-4709-899b-ceceb72dd880 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:32.061446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c6dc1-cf0c-48a7-afe4-19f250496d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:32.063660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c6dc1-cf0c-48a7-afe4-19f250496d7f None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:32.064146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c6dc1-cf0c-48a7-afe4-19f250496d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:32.064597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c6dc1-cf0c-48a7-afe4-19f250496d7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:32.070318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c6dc1-cf0c-48a7-afe4-19f250496d7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:32.070318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c6dc1-cf0c-48a7-afe4-19f250496d7f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:32.125074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bcbd1-1da7-469b-8c9c-c7a716d70825 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:32.160326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacf73-b874-4243-a531-e488e032e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:32.161116 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacf73-b874-4243-a531-e488e032e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:32.161449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacf73-b874-4243-a531-e488e032e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:32.161730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacf73-b874-4243-a531-e488e032e8d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:32.162407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbacf73-b874-4243-a531-e488e032e8d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:32.163774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbacf73-b874-4243-a531-e488e032e8d7 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-5cbacf73-b874-4243-a531-e488e032e8d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:32.176025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:32.177017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:33:32.177879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:32.182668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 412/821] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:32 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:32.183408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacf73-b874-4243-a531-e488e032e8d7 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:32.198744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 410/822] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 10:33:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:32.200998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c6dc1-cf0c-48a7-afe4-19f250496d7f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:32.318896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:32.393661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacf73-b874-4243-a531-e488e032e8d7 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:32.401031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c6dc1-cf0c-48a7-afe4-19f250496d7f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:32.431577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8223622-5a95-46da-ab65-712d8c37b375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:32.432405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8223622-5a95-46da-ab65-712d8c37b375 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:32.433040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8223622-5a95-46da-ab65-712d8c37b375 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:32.433040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8223622-5a95-46da-ab65-712d8c37b375 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:32.442103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188f653-739a-4cd8-8f8e-519734c42ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:32.443215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188f653-739a-4cd8-8f8e-519734c42ca3 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:32.443337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8223622-5a95-46da-ab65-712d8c37b375 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:32.443828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188f653-739a-4cd8-8f8e-519734c42ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:32.444314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188f653-739a-4cd8-8f8e-519734c42ca3 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:32.444812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8223622-5a95-46da-ab65-712d8c37b375 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:32.445465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188f653-739a-4cd8-8f8e-519734c42ca3 None admin] RBAC: Adding query filter params (name=network) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:32.446004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188f653-739a-4cd8-8f8e-519734c42ca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:32.447873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188f653-739a-4cd8-8f8e-519734c42ca3 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:32.453581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 411/823] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:32.459092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188f653-739a-4cd8-8f8e-519734c42ca3 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-b8223622-5a95-46da-ab65-712d8c37b375 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:32.463118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:32.464073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:32.465028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:32.467172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 413/824] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:32.471533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8223622-5a95-46da-ab65-712d8c37b375 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:32.484708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:32.580503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188f653-739a-4cd8-8f8e-519734c42ca3 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:32.582550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8223622-5a95-46da-ab65-712d8c37b375 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:32.606733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:32.618205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703e32b-0d4e-4bd9-9b24-ad87f5272b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:32.619415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703e32b-0d4e-4bd9-9b24-ad87f5272b2f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:32.619701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703e32b-0d4e-4bd9-9b24-ad87f5272b2f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:32.619985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703e32b-0d4e-4bd9-9b24-ad87f5272b2f None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:32.620705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703e32b-0d4e-4bd9-9b24-ad87f5272b2f None admin] RBAC: Adding query filter params (type=network) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:32.620937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438d67e-4b97-43fa-b831-404a5c2e9a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:32.621049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703e32b-0d4e-4bd9-9b24-ad87f5272b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:32.621914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438d67e-4b97-43fa-b831-404a5c2e9a57 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:32.622433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438d67e-4b97-43fa-b831-404a5c2e9a57 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:32.622544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703e32b-0d4e-4bd9-9b24-ad87f5272b2f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:32.623002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438d67e-4b97-43fa-b831-404a5c2e9a57 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:32.624220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438d67e-4b97-43fa-b831-404a5c2e9a57 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:32.624788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438d67e-4b97-43fa-b831-404a5c2e9a57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:32.626440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438d67e-4b97-43fa-b831-404a5c2e9a57 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:32.630819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 412/825] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:32.639184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703e32b-0d4e-4bd9-9b24-ad87f5272b2f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:32.651041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 414/826] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 10:33:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:32.656448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438d67e-4b97-43fa-b831-404a5c2e9a57 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:32.748092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:32.774195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703e32b-0d4e-4bd9-9b24-ad87f5272b2f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:32.804283 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438d67e-4b97-43fa-b831-404a5c2e9a57 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:32.818234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1e739-752a-422d-95b1-45bd88dd0197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:32.819137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1e739-752a-422d-95b1-45bd88dd0197 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:32.820140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1e739-752a-422d-95b1-45bd88dd0197 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:32.820560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1e739-752a-422d-95b1-45bd88dd0197 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:32.821479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1e739-752a-422d-95b1-45bd88dd0197 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:32.823008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1e739-752a-422d-95b1-45bd88dd0197 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:32.862264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2929e0-3adc-4be8-95d5-beaec698b327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:32.863249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2929e0-3adc-4be8-95d5-beaec698b327 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:32.863664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2929e0-3adc-4be8-95d5-beaec698b327 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:32.864048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2929e0-3adc-4be8-95d5-beaec698b327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:32.876896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2929e0-3adc-4be8-95d5-beaec698b327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:32.878761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2929e0-3adc-4be8-95d5-beaec698b327 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-4e2929e0-3adc-4be8-95d5-beaec698b327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:32.901960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:32.902862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:32.904146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:32.904146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:32.904146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:32.904146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:32.905970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 415/827] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:32.908444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2929e0-3adc-4be8-95d5-beaec698b327 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:32.933385 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 413/828] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 10:33:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:33:32.948999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:33.031075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2929e0-3adc-4be8-95d5-beaec698b327 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:33.078020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8f191-1e0a-4c0e-9f33-c036a715dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:33.078706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8f191-1e0a-4c0e-9f33-c036a715dd44 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.078998 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8f191-1e0a-4c0e-9f33-c036a715dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.079281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8f191-1e0a-4c0e-9f33-c036a715dd44 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.080095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8f191-1e0a-4c0e-9f33-c036a715dd44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:33.080412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8f191-1e0a-4c0e-9f33-c036a715dd44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:33.081930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8f191-1e0a-4c0e-9f33-c036a715dd44 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:33.095456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 416/829] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:33.101444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1e739-752a-422d-95b1-45bd88dd0197 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:33.239337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1e739-752a-422d-95b1-45bd88dd0197 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:33.281855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788738a-dfbc-41eb-9386-7eeaeb082f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:33.283042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788738a-dfbc-41eb-9386-7eeaeb082f3e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.283565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788738a-dfbc-41eb-9386-7eeaeb082f3e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.284055 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788738a-dfbc-41eb-9386-7eeaeb082f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.287358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:33.294152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788738a-dfbc-41eb-9386-7eeaeb082f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:33.295609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788738a-dfbc-41eb-9386-7eeaeb082f3e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-1788738a-dfbc-41eb-9386-7eeaeb082f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:33.311906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:33.317305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:33.318261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:33.318261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:33.318261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:33.318261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:33.318261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:33.318261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:33.318261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:33.318261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:33.318261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 414/830] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:33.321419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8f191-1e0a-4c0e-9f33-c036a715dd44 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:33.387537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147fa5-1c49-4612-955a-a31228519e82 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.387909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147fa5-1c49-4612-955a-a31228519e82 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.388100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147fa5-1c49-4612-955a-a31228519e82 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.389728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 415/831] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:33.394754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f847-0e36-4b3c-acc7-6ea5c876c04d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.394948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f847-0e36-4b3c-acc7-6ea5c876c04d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.395223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f847-0e36-4b3c-acc7-6ea5c876c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.415737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c212f847-0e36-4b3c-acc7-6ea5c876c04d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:33.417312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c212f847-0e36-4b3c-acc7-6ea5c876c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:33.452400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:33.472764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8f191-1e0a-4c0e-9f33-c036a715dd44 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:33.515637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f518a54-50a8-48f5-a591-43837c9526c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:33.516717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f518a54-50a8-48f5-a591-43837c9526c9 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.517234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f518a54-50a8-48f5-a591-43837c9526c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.517743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f518a54-50a8-48f5-a591-43837c9526c9 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.518827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f518a54-50a8-48f5-a591-43837c9526c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:33.519539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f518a54-50a8-48f5-a591-43837c9526c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:33.521274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f518a54-50a8-48f5-a591-43837c9526c9 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:33.537216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 417/832] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:33.543627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f518a54-50a8-48f5-a591-43837c9526c9 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:33.616098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 416/833] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:33.643004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212f847-0e36-4b3c-acc7-6ea5c876c04d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:33.681847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f518a54-50a8-48f5-a591-43837c9526c9 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:33.734133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ded51-b5f6-4fc0-a2a6-d41793b587b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:33.736483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ded51-b5f6-4fc0-a2a6-d41793b587b0 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.737016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ded51-b5f6-4fc0-a2a6-d41793b587b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.737506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ded51-b5f6-4fc0-a2a6-d41793b587b0 None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/f93427bde8154d509bc67675b03903db/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.740770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ded51-b5f6-4fc0-a2a6-d41793b587b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=f93427bde8154d509bc67675b03903db, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:33.742970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ded51-b5f6-4fc0-a2a6-d41793b587b0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:33.749174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212f847-0e36-4b3c-acc7-6ea5c876c04d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:33.773855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:33.784796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e092f-1a9c-4c88-8c9d-458938bfbb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:33.785733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e092f-1a9c-4c88-8c9d-458938bfbb92 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.786106 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e092f-1a9c-4c88-8c9d-458938bfbb92 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.786449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e092f-1a9c-4c88-8c9d-458938bfbb92 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.787166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e092f-1a9c-4c88-8c9d-458938bfbb92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:33.788605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e092f-1a9c-4c88-8c9d-458938bfbb92 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-437e092f-1a9c-4c88-8c9d-458938bfbb92 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:33.801985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:33.803021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:33:33.803880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:33.807994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 417/834] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jun 30 10:33:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:33.807994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e092f-1a9c-4c88-8c9d-458938bfbb92 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:33.829385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 418/835] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:33:33 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/f93427bde8154d509bc67675b03903db/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:33:33.886334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc392-9a30-4595-947c-c13cef8d5d88 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.886605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc392-9a30-4595-947c-c13cef8d5d88 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.886894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc392-9a30-4595-947c-c13cef8d5d88 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.888581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 419/836] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:33:33.903862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a15a-649c-4f37-8f2c-0f81bc921870 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.904297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a15a-649c-4f37-8f2c-0f81bc921870 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.904681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a15a-649c-4f37-8f2c-0f81bc921870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.926929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-6a15a15a-649c-4f37-8f2c-0f81bc921870 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:33.929070 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6a15a15a-649c-4f37-8f2c-0f81bc921870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:33.941809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e092f-1a9c-4c88-8c9d-458938bfbb92 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:33.942348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:33.983027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39e143-456c-49a7-b6a5-9edc59762e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:33.983943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e143-456c-49a7-b6a5-9edc59762e92 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:33.984330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e143-456c-49a7-b6a5-9edc59762e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:33.984710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e143-456c-49a7-b6a5-9edc59762e92 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:33.985598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39e143-456c-49a7-b6a5-9edc59762e92 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:33.986056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39e143-456c-49a7-b6a5-9edc59762e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:33.987662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39e143-456c-49a7-b6a5-9edc59762e92 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:33.998252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 418/837] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:33.999711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39e143-456c-49a7-b6a5-9edc59762e92 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:34.037741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 420/838] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:34.059059 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:34.064642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15a15a-649c-4f37-8f2c-0f81bc921870 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:34.108724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39e143-456c-49a7-b6a5-9edc59762e92 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:34.144760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6878755-2e28-416f-b07b-9792e9193321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:34.145687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878755-2e28-416f-b07b-9792e9193321 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:34.146146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878755-2e28-416f-b07b-9792e9193321 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:34.146656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878755-2e28-416f-b07b-9792e9193321 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:34.147627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6878755-2e28-416f-b07b-9792e9193321 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:34.148138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6878755-2e28-416f-b07b-9792e9193321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:34.149725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6878755-2e28-416f-b07b-9792e9193321 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:34.155011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 419/839] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:34.186412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15a15a-649c-4f37-8f2c-0f81bc921870 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:34.226334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52574efa-6f40-4a18-afb5-b76ba333d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:34.227155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52574efa-6f40-4a18-afb5-b76ba333d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:34.228031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52574efa-6f40-4a18-afb5-b76ba333d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:34.228310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52574efa-6f40-4a18-afb5-b76ba333d2d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:34.236814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:34.242595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52574efa-6f40-4a18-afb5-b76ba333d2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-52574efa-6f40-4a18-afb5-b76ba333d2d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:34.251666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:34.275375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:34.276219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 421/840] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:34.276919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6878755-2e28-416f-b07b-9792e9193321 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:34.383698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6878755-2e28-416f-b07b-9792e9193321 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:34.400582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:34.418742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71869a46-a2d9-43d5-9e9d-80cf8e162e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:34.424794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71869a46-a2d9-43d5-9e9d-80cf8e162e1d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:34.424794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71869a46-a2d9-43d5-9e9d-80cf8e162e1d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:34.424794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71869a46-a2d9-43d5-9e9d-80cf8e162e1d None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:34.424794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71869a46-a2d9-43d5-9e9d-80cf8e162e1d None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:34.424794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71869a46-a2d9-43d5-9e9d-80cf8e162e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:34.424794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71869a46-a2d9-43d5-9e9d-80cf8e162e1d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:34.436603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 420/841] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:33:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:34.438189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52574efa-6f40-4a18-afb5-b76ba333d2d1 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:34.543768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52574efa-6f40-4a18-afb5-b76ba333d2d1 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:34.579019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0759b6f-471c-4244-b523-b0986da218e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:34.580136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0759b6f-471c-4244-b523-b0986da218e4 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:34.580585 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0759b6f-471c-4244-b523-b0986da218e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:34.581010 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0759b6f-471c-4244-b523-b0986da218e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:34.592987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0759b6f-471c-4244-b523-b0986da218e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:34.594709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0759b6f-471c-4244-b523-b0986da218e4 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-e0759b6f-471c-4244-b523-b0986da218e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:34.613533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:34.619368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:34.620489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:34.620489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:34.620489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:34.620489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:34.620489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 422/842] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:34.623986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71869a46-a2d9-43d5-9e9d-80cf8e162e1d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:34.729004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71869a46-a2d9-43d5-9e9d-80cf8e162e1d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:34.763090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f7146-9a4f-4743-a4e6-c8e8f2bcee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:34.764420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f7146-9a4f-4743-a4e6-c8e8f2bcee84 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:34.764850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f7146-9a4f-4743-a4e6-c8e8f2bcee84 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:34.765272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f7146-9a4f-4743-a4e6-c8e8f2bcee84 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:34.766251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f7146-9a4f-4743-a4e6-c8e8f2bcee84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:34.766706 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f7146-9a4f-4743-a4e6-c8e8f2bcee84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:34.768266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f7146-9a4f-4743-a4e6-c8e8f2bcee84 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:34.786066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 421/843] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:34.787873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0759b6f-471c-4244-b523-b0986da218e4 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:34.836213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc1c3e-6693-4948-9966-9ef88157a0c4 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:34.836521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc1c3e-6693-4948-9966-9ef88157a0c4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:34.836785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc1c3e-6693-4948-9966-9ef88157a0c4 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:34.838970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 422/844] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:33:34.842312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:34.845076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ec27-4b38-45d4-bdd4-65a03836b43f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:34.845368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ec27-4b38-45d4-bdd4-65a03836b43f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:34.845653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ec27-4b38-45d4-bdd4-65a03836b43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:34.863038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-abd7ec27-4b38-45d4-bdd4-65a03836b43f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:34.864385 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-abd7ec27-4b38-45d4-bdd4-65a03836b43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:34.898349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0759b6f-471c-4244-b523-b0986da218e4 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:34.898873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:34.939380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59ba5e-994f-485b-8dc8-f76643db485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:34.939598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 423/845] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:34.940266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59ba5e-994f-485b-8dc8-f76643db485d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:34.940675 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59ba5e-994f-485b-8dc8-f76643db485d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:34.940956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59ba5e-994f-485b-8dc8-f76643db485d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:34.962653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ec27-4b38-45d4-bdd4-65a03836b43f None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:35.071921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59ba5e-994f-485b-8dc8-f76643db485d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:35.073401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59ba5e-994f-485b-8dc8-f76643db485d None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:35.074941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ec27-4b38-45d4-bdd4-65a03836b43f None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-8c59ba5e-994f-485b-8dc8-f76643db485d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:35.090630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:35.091646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:35.092581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:35.096651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 423/846] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:33:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:35.098293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59ba5e-994f-485b-8dc8-f76643db485d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:35.121384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913828a-b6ad-4ab3-83a7-36724b4d3837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:35.123070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913828a-b6ad-4ab3-83a7-36724b4d3837 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:35.123845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913828a-b6ad-4ab3-83a7-36724b4d3837 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:35.124321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913828a-b6ad-4ab3-83a7-36724b4d3837 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:35.125433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913828a-b6ad-4ab3-83a7-36724b4d3837 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:35.127740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913828a-b6ad-4ab3-83a7-36724b4d3837 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-d913828a-b6ad-4ab3-83a7-36724b4d3837 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:35.142925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:35.143933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:35.144817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 424/847] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:33:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:35.150349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913828a-b6ad-4ab3-83a7-36724b4d3837 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:35.188486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:35.215018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59ba5e-994f-485b-8dc8-f76643db485d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:35.229869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:35.259700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03444c6e-a48b-46fa-b195-f1db9e75741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:35.260393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03444c6e-a48b-46fa-b195-f1db9e75741e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:35.260678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03444c6e-a48b-46fa-b195-f1db9e75741e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:35.261250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03444c6e-a48b-46fa-b195-f1db9e75741e None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:35.262953 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03444c6e-a48b-46fa-b195-f1db9e75741e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:35.263614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03444c6e-a48b-46fa-b195-f1db9e75741e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:35.265640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03444c6e-a48b-46fa-b195-f1db9e75741e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:35.270177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913828a-b6ad-4ab3-83a7-36724b4d3837 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:35.287758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 424/848] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 10:33:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:35.293409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03444c6e-a48b-46fa-b195-f1db9e75741e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:35.310727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c64918-7d4d-4583-96e6-ea0fe6ed98ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:35.311562 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c64918-7d4d-4583-96e6-ea0fe6ed98ca None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:35.311901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c64918-7d4d-4583-96e6-ea0fe6ed98ca None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:35.312255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c64918-7d4d-4583-96e6-ea0fe6ed98ca None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:35.313053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c64918-7d4d-4583-96e6-ea0fe6ed98ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:35.313429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c64918-7d4d-4583-96e6-ea0fe6ed98ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:35.315173 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c64918-7d4d-4583-96e6-ea0fe6ed98ca None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:35.320704 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 425/849] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:33:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:35.327836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c64918-7d4d-4583-96e6-ea0fe6ed98ca None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:35.402505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03444c6e-a48b-46fa-b195-f1db9e75741e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:35.438607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4058c-8831-4611-a4c9-2519076cd90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:35.439517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4058c-8831-4611-a4c9-2519076cd90c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:35.439802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4058c-8831-4611-a4c9-2519076cd90c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:35.440324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4058c-8831-4611-a4c9-2519076cd90c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:35.441248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:35.448189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c64918-7d4d-4583-96e6-ea0fe6ed98ca None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:35.484596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:35.491187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9079-9e4f-4cfa-89f5-6961b1e4acbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:35.491857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9079-9e4f-4cfa-89f5-6961b1e4acbf None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:35.492142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9079-9e4f-4cfa-89f5-6961b1e4acbf None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:35.492420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9079-9e4f-4cfa-89f5-6961b1e4acbf None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:35.493678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d9079-9e4f-4cfa-89f5-6961b1e4acbf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:35.494347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d9079-9e4f-4cfa-89f5-6961b1e4acbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:35.496041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d9079-9e4f-4cfa-89f5-6961b1e4acbf None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:35.506115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 426/850] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:33:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:35.529400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4058c-8831-4611-a4c9-2519076cd90c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:35.531332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4058c-8831-4611-a4c9-2519076cd90c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:35.648908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 425/851] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:35.651555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9079-9e4f-4cfa-89f5-6961b1e4acbf None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:35.758474 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9079-9e4f-4cfa-89f5-6961b1e4acbf None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:35.793784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cfdaf-9b69-4be3-ae9c-fab77200d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:35.795335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cfdaf-9b69-4be3-ae9c-fab77200d54e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:35.795835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cfdaf-9b69-4be3-ae9c-fab77200d54e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:35.796270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cfdaf-9b69-4be3-ae9c-fab77200d54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:35.807703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cfdaf-9b69-4be3-ae9c-fab77200d54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:35.809657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cfdaf-9b69-4be3-ae9c-fab77200d54e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-c75cfdaf-9b69-4be3-ae9c-fab77200d54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:35.828503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:35.829685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:35.830818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:35.830818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:35.830818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:35.830818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:35.837084 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 427/852] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:35.838600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4058c-8831-4611-a4c9-2519076cd90c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:35.907135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:35.940832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4058c-8831-4611-a4c9-2519076cd90c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:35.976346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b42d5-db68-4658-86d9-7d04a1aac638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:35.977012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b42d5-db68-4658-86d9-7d04a1aac638 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:35.977296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b42d5-db68-4658-86d9-7d04a1aac638 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:35.978171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b42d5-db68-4658-86d9-7d04a1aac638 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:35.978899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b42d5-db68-4658-86d9-7d04a1aac638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:35.979207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b42d5-db68-4658-86d9-7d04a1aac638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:35.980584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b42d5-db68-4658-86d9-7d04a1aac638 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:35.997127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 426/853] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:35.998507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cfdaf-9b69-4be3-ae9c-fab77200d54e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:36.018363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:36.041864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b5e2b-69e4-4edb-beb7-e58de3ebc637 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.042187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b5e2b-69e4-4edb-beb7-e58de3ebc637 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.042467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b5e2b-69e4-4edb-beb7-e58de3ebc637 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.043834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 427/854] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:36.048815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667521c1-9558-4086-b8be-6424ce23a7b4 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.049107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667521c1-9558-4086-b8be-6424ce23a7b4 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.049387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667521c1-9558-4086-b8be-6424ce23a7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.068407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-667521c1-9558-4086-b8be-6424ce23a7b4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:36.069603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-667521c1-9558-4086-b8be-6424ce23a7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:36.112321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cfdaf-9b69-4be3-ae9c-fab77200d54e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:36.153386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d79cd1-d095-49c6-a7e6-cbcb0208ac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:36.154207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d79cd1-d095-49c6-a7e6-cbcb0208ac9e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.154500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d79cd1-d095-49c6-a7e6-cbcb0208ac9e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.154777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d79cd1-d095-49c6-a7e6-cbcb0208ac9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.158135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 428/855] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:36.169336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d79cd1-d095-49c6-a7e6-cbcb0208ac9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:36.170823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d79cd1-d095-49c6-a7e6-cbcb0208ac9e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:36.179895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667521c1-9558-4086-b8be-6424ce23a7b4 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-16d79cd1-d095-49c6-a7e6-cbcb0208ac9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:36.188500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:36.189393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:36.190700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:36.190700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:36.190700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:36.190700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:36.190700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:36.190700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:36.190700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:36.190700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:36.192951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 428/856] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:36.199790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d79cd1-d095-49c6-a7e6-cbcb0208ac9e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:36.247951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:36.276760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:36.292761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667521c1-9558-4086-b8be-6424ce23a7b4 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:36.309873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d79cd1-d095-49c6-a7e6-cbcb0208ac9e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:36.329971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761fa5d-04b7-461b-9317-f6f8a2fe6cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:36.330776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761fa5d-04b7-461b-9317-f6f8a2fe6cfc None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.331061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761fa5d-04b7-461b-9317-f6f8a2fe6cfc None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.331338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761fa5d-04b7-461b-9317-f6f8a2fe6cfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.342786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761fa5d-04b7-461b-9317-f6f8a2fe6cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:36.346172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26ebd7-cba8-4adf-ad55-9b5722614b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:36.346952 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26ebd7-cba8-4adf-ad55-9b5722614b10 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.347339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26ebd7-cba8-4adf-ad55-9b5722614b10 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.347718 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26ebd7-cba8-4adf-ad55-9b5722614b10 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.348857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26ebd7-cba8-4adf-ad55-9b5722614b10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:36.349270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26ebd7-cba8-4adf-ad55-9b5722614b10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-0761fa5d-04b7-461b-9317-f6f8a2fe6cfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:36.350629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:36.351697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:36.353169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 429/857] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:36.354242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4613c-e72a-4a1b-bf8b-c69617594500 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.354362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4613c-e72a-4a1b-bf8b-c69617594500 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.354590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4613c-e72a-4a1b-bf8b-c69617594500 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.355977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 430/858] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:36.357302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26ebd7-cba8-4adf-ad55-9b5722614b10 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:36.360469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4613c-e72a-4a1b-bf8b-c69617594500 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:36.375221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 429/859] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:36.375221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b50c2-2d27-44e9-9786-4bc7fe8efce2 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.375221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b50c2-2d27-44e9-9786-4bc7fe8efce2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.375221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b50c2-2d27-44e9-9786-4bc7fe8efce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.390044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b75b50c2-2d27-44e9-9786-4bc7fe8efce2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:36.391218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b75b50c2-2d27-44e9-9786-4bc7fe8efce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:36.456810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 430/860] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:36.457384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b50c2-2d27-44e9-9786-4bc7fe8efce2 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:36.474664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4613c-e72a-4a1b-bf8b-c69617594500 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:36.496308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:36.513548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526375c5-39f4-49aa-912c-e343014654e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:36.514245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526375c5-39f4-49aa-912c-e343014654e7 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.514538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526375c5-39f4-49aa-912c-e343014654e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.514816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526375c5-39f4-49aa-912c-e343014654e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.515568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526375c5-39f4-49aa-912c-e343014654e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:36.515876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526375c5-39f4-49aa-912c-e343014654e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:36.517252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526375c5-39f4-49aa-912c-e343014654e7 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:36.526681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 431/861] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:36.527468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526375c5-39f4-49aa-912c-e343014654e7 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:36.533512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:36.573278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b50c2-2d27-44e9-9786-4bc7fe8efce2 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:36.609396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4a66-43b2-46a1-b1e4-5c45e3102a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:36.610385 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4a66-43b2-46a1-b1e4-5c45e3102a8f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.615465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4a66-43b2-46a1-b1e4-5c45e3102a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.615465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4a66-43b2-46a1-b1e4-5c45e3102a8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.615465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4a66-43b2-46a1-b1e4-5c45e3102a8f None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=25df9d4438a34863bbde92da4be8c0df) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:36.615465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4a66-43b2-46a1-b1e4-5c45e3102a8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:36.615465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4a66-43b2-46a1-b1e4-5c45e3102a8f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:36.621352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 431/862] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:36 2022] GET /identity/v3/role_assignments?user.id=25df9d4438a34863bbde92da4be8c0df&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:36.622329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4a66-43b2-46a1-b1e4-5c45e3102a8f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:36.654142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526375c5-39f4-49aa-912c-e343014654e7 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:36.697203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d50ff-7853-456a-869e-5c56baf60aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:36.698124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d50ff-7853-456a-869e-5c56baf60aaa None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.698503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d50ff-7853-456a-869e-5c56baf60aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.698920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d50ff-7853-456a-869e-5c56baf60aaa None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.699770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d50ff-7853-456a-869e-5c56baf60aaa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:36.701327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d50ff-7853-456a-869e-5c56baf60aaa None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:36.749370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4a66-43b2-46a1-b1e4-5c45e3102a8f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:36.790277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 432/863] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:33:36 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:36.791979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:36.810053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d995124-ebff-48a0-ac95-723fe4a16ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:36.811162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d995124-ebff-48a0-ac95-723fe4a16ba3 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:36.811456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d995124-ebff-48a0-ac95-723fe4a16ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:36.811740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d995124-ebff-48a0-ac95-723fe4a16ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:36.826901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d995124-ebff-48a0-ac95-723fe4a16ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:36.828592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d995124-ebff-48a0-ac95-723fe4a16ba3 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-2d995124-ebff-48a0-ac95-723fe4a16ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:36.851830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:36.852937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:36.853821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:36.853821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:36.853821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:36.853821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:36.853821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 432/864] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:36.859438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d50ff-7853-456a-869e-5c56baf60aaa None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:36.910709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:36.979627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d50ff-7853-456a-869e-5c56baf60aaa None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:37.015859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febe952-7026-46fb-9bad-dceec07a1c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:37.016452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe952-7026-46fb-9bad-dceec07a1c34 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:37.016740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe952-7026-46fb-9bad-dceec07a1c34 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:37.017014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe952-7026-46fb-9bad-dceec07a1c34 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:37.017738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febe952-7026-46fb-9bad-dceec07a1c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:37.018077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febe952-7026-46fb-9bad-dceec07a1c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:37.019450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febe952-7026-46fb-9bad-dceec07a1c34 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:37.036975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 433/865] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:37.038346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d995124-ebff-48a0-ac95-723fe4a16ba3 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:37.151915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d995124-ebff-48a0-ac95-723fe4a16ba3 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:37.186983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991c437-29a3-431f-bc26-2cd3228c7ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:37.187796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991c437-29a3-431f-bc26-2cd3228c7ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:37.188085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991c437-29a3-431f-bc26-2cd3228c7ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:37.188366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991c437-29a3-431f-bc26-2cd3228c7ca4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:37.196904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991c437-29a3-431f-bc26-2cd3228c7ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:37.198389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991c437-29a3-431f-bc26-2cd3228c7ca4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-8991c437-29a3-431f-bc26-2cd3228c7ca4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:37.212867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:37.213830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:37.215218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 433/866] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:33:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:37.221804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febe952-7026-46fb-9bad-dceec07a1c34 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:37.347441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febe952-7026-46fb-9bad-dceec07a1c34 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:37.349274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:37.383709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98f7da-bfa6-4fa9-ac0c-3a93718e336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:37.384455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98f7da-bfa6-4fa9-ac0c-3a93718e336f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:37.384678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98f7da-bfa6-4fa9-ac0c-3a93718e336f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:37.384958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98f7da-bfa6-4fa9-ac0c-3a93718e336f None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:37.385808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98f7da-bfa6-4fa9-ac0c-3a93718e336f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:37.386155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98f7da-bfa6-4fa9-ac0c-3a93718e336f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:37.387662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98f7da-bfa6-4fa9-ac0c-3a93718e336f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:37.406128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 434/867] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jun 30 10:33:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:37.415561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991c437-29a3-431f-bc26-2cd3228c7ca4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:37.450782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:37.519634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991c437-29a3-431f-bc26-2cd3228c7ca4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:37.559171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551f81-8102-47a8-830c-097157f77b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:37.560009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551f81-8102-47a8-830c-097157f77b4c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:37.560404 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551f81-8102-47a8-830c-097157f77b4c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:37.560797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551f81-8102-47a8-830c-097157f77b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:37.631962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b94cf-58b8-40ce-b2c0-642e063125fa None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:37.632348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b94cf-58b8-40ce-b2c0-642e063125fa None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:37.632874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b94cf-58b8-40ce-b2c0-642e063125fa None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:37.634633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 435/868] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:37.639517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba551f81-8102-47a8-830c-097157f77b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:37.640226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278331-d1f5-4806-9758-e2d759e625cd None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:37.640597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278331-d1f5-4806-9758-e2d759e625cd None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:37.640975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278331-d1f5-4806-9758-e2d759e625cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:37.641841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba551f81-8102-47a8-830c-097157f77b4c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:37.658744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d2278331-d1f5-4806-9758-e2d759e625cd None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:37.660148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d2278331-d1f5-4806-9758-e2d759e625cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:37.686295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:37.735665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 436/869] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:37 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:37.745502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 434/870] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:37 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:37.753959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2278331-d1f5-4806-9758-e2d759e625cd None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:37.759481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551f81-8102-47a8-830c-097157f77b4c None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:37.851699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:37.864096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2278331-d1f5-4806-9758-e2d759e625cd None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:37.888767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551f81-8102-47a8-830c-097157f77b4c None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:37.910399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97843680-7dc1-4cbc-81e9-f6998497e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:37.911430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97843680-7dc1-4cbc-81e9-f6998497e7ed None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:37.911867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97843680-7dc1-4cbc-81e9-f6998497e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:37.912300 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97843680-7dc1-4cbc-81e9-f6998497e7ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:37.923334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97843680-7dc1-4cbc-81e9-f6998497e7ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:37.925071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97843680-7dc1-4cbc-81e9-f6998497e7ed None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:37.929244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83d62b-0dfb-4dce-a0ea-b65cf18c3e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:37.930016 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83d62b-0dfb-4dce-a0ea-b65cf18c3e62 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:37.930888 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83d62b-0dfb-4dce-a0ea-b65cf18c3e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:37.931245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83d62b-0dfb-4dce-a0ea-b65cf18c3e62 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:37.932034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83d62b-0dfb-4dce-a0ea-b65cf18c3e62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:37.933448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83d62b-0dfb-4dce-a0ea-b65cf18c3e62 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:37.936588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-97843680-7dc1-4cbc-81e9-f6998497e7ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:37.946029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:37.947450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:37.948397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:37.948397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:37.948397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:37.948397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:37.952661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 437/871] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:37.953299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97843680-7dc1-4cbc-81e9-f6998497e7ed None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:38.001602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 435/872] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:33:37 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:38.079100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97843680-7dc1-4cbc-81e9-f6998497e7ed None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:38.124635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78ae79-ad1d-4d3c-9c0d-8d069aa86d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:38.125710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78ae79-ad1d-4d3c-9c0d-8d069aa86d28 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:38.126225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78ae79-ad1d-4d3c-9c0d-8d069aa86d28 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:38.126713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78ae79-ad1d-4d3c-9c0d-8d069aa86d28 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:38.127639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78ae79-ad1d-4d3c-9c0d-8d069aa86d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:38.128163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78ae79-ad1d-4d3c-9c0d-8d069aa86d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:38.129754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78ae79-ad1d-4d3c-9c0d-8d069aa86d28 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:38.132780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:38.144580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 438/873] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:38.151105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83d62b-0dfb-4dce-a0ea-b65cf18c3e62 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:38.262699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83d62b-0dfb-4dce-a0ea-b65cf18c3e62 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:38.296686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2365dde-b41b-4d0b-acc2-f4975d1fc980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:38.297540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2365dde-b41b-4d0b-acc2-f4975d1fc980 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:38.297834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2365dde-b41b-4d0b-acc2-f4975d1fc980 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:38.298141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2365dde-b41b-4d0b-acc2-f4975d1fc980 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:38.304918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2365dde-b41b-4d0b-acc2-f4975d1fc980 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:38.307009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2365dde-b41b-4d0b-acc2-f4975d1fc980 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-a2365dde-b41b-4d0b-acc2-f4975d1fc980 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:38.321167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:38.322100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:38.323400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:38.323400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:38.323400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:38.323400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:38.323400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:38.323400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:38.323400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:38.323400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:38.323400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 436/874] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:38.328544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78ae79-ad1d-4d3c-9c0d-8d069aa86d28 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:38.437003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78ae79-ad1d-4d3c-9c0d-8d069aa86d28 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:38.473563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855a052-2cb6-4240-be0c-2439a8ee4c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:38.474268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855a052-2cb6-4240-be0c-2439a8ee4c09 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:38.474557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855a052-2cb6-4240-be0c-2439a8ee4c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:38.474839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855a052-2cb6-4240-be0c-2439a8ee4c09 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:38.475628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855a052-2cb6-4240-be0c-2439a8ee4c09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:38.475942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855a052-2cb6-4240-be0c-2439a8ee4c09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:38.477961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855a052-2cb6-4240-be0c-2439a8ee4c09 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:38.491095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 439/875] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:38.497097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2365dde-b41b-4d0b-acc2-f4975d1fc980 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:38.556339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:38.603647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2365dde-b41b-4d0b-acc2-f4975d1fc980 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:38.638931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec0b91-4913-4758-835d-89863aa072b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:38.639941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0b91-4913-4758-835d-89863aa072b9 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:38.640425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0b91-4913-4758-835d-89863aa072b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:38.640898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0b91-4913-4758-835d-89863aa072b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:38.641958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec0b91-4913-4758-835d-89863aa072b9 None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=f93427bde8154d509bc67675b03903db) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:38.642493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec0b91-4913-4758-835d-89863aa072b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:38.644139 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec0b91-4913-4758-835d-89863aa072b9 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:38.651335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 437/876] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:38 2022] GET /identity/v3/role_assignments?user.id=f93427bde8154d509bc67675b03903db&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:38.958636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef31b0-eb68-4581-89ae-b09b1d3d1ca8 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:38.958984 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef31b0-eb68-4581-89ae-b09b1d3d1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:38.959203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef31b0-eb68-4581-89ae-b09b1d3d1ca8 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:38.960796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 440/877] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:38.966657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bec75-e2d8-4252-b0c0-7b6ce1ddcf55 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:38.967097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bec75-e2d8-4252-b0c0-7b6ce1ddcf55 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:38.967281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bec75-e2d8-4252-b0c0-7b6ce1ddcf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:38.970525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a8f5-2b36-4f48-a681-01a0217c5ce6 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:38.970815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a8f5-2b36-4f48-a681-01a0217c5ce6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:38.971094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a8f5-2b36-4f48-a681-01a0217c5ce6 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:38.972390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 441/878] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:33:38.977475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61cc4b-ac75-44b5-876d-a342745486b2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:38.977766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61cc4b-ac75-44b5-876d-a342745486b2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:38.978088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61cc4b-ac75-44b5-876d-a342745486b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:38.984883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-631bec75-e2d8-4252-b0c0-7b6ce1ddcf55 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:38.986134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-631bec75-e2d8-4252-b0c0-7b6ce1ddcf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:38.994762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-af61cc4b-ac75-44b5-876d-a342745486b2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:38.996492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-af61cc4b-ac75-44b5-876d-a342745486b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:39.067350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 438/879] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:39.069431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:39.088059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 442/880] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:39.093909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bec75-e2d8-4252-b0c0-7b6ce1ddcf55 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.115787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61cc4b-ac75-44b5-876d-a342745486b2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.146253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:39.199372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bec75-e2d8-4252-b0c0-7b6ce1ddcf55 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.221805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61cc4b-ac75-44b5-876d-a342745486b2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.235174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729c0cf-317b-4865-a773-9d90269048da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:39.235982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729c0cf-317b-4865-a773-9d90269048da None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:39.236261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729c0cf-317b-4865-a773-9d90269048da None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:39.236533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729c0cf-317b-4865-a773-9d90269048da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:39.247735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729c0cf-317b-4865-a773-9d90269048da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-7729c0cf-317b-4865-a773-9d90269048da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:39.257564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:39.259247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:33:39.260303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:39.266081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 439/881] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:39.266293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30131637-4bb9-4120-b250-f447123ff785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:39.266521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30131637-4bb9-4120-b250-f447123ff785 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:39.267131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30131637-4bb9-4120-b250-f447123ff785 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:39.267131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30131637-4bb9-4120-b250-f447123ff785 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:39.268062 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729c0cf-317b-4865-a773-9d90269048da None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.269159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30131637-4bb9-4120-b250-f447123ff785 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:39.271350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30131637-4bb9-4120-b250-f447123ff785 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-30131637-4bb9-4120-b250-f447123ff785 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:39.287249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:39.288278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:39.289135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 443/882] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:39.294338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30131637-4bb9-4120-b250-f447123ff785 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.358203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:39.406084 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729c0cf-317b-4865-a773-9d90269048da None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.417513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:39.432945 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30131637-4bb9-4120-b250-f447123ff785 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.443060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d03035-757b-431a-a199-909884b32aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:39.443670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03035-757b-431a-a199-909884b32aab None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:39.443955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03035-757b-431a-a199-909884b32aab None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:39.444233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03035-757b-431a-a199-909884b32aab None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:39.444987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d03035-757b-431a-a199-909884b32aab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:39.445296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d03035-757b-431a-a199-909884b32aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:39.447247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d03035-757b-431a-a199-909884b32aab None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:39.460778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 440/883] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:39.461857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d03035-757b-431a-a199-909884b32aab None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.482761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7da4f9-521d-41b8-9b05-ca88613ec696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:39.483576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7da4f9-521d-41b8-9b05-ca88613ec696 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:39.483959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7da4f9-521d-41b8-9b05-ca88613ec696 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:39.484378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7da4f9-521d-41b8-9b05-ca88613ec696 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:39.485279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7da4f9-521d-41b8-9b05-ca88613ec696 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:39.485687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7da4f9-521d-41b8-9b05-ca88613ec696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:39.487268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7da4f9-521d-41b8-9b05-ca88613ec696 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:39.492597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 444/884] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:39.498404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7da4f9-521d-41b8-9b05-ca88613ec696 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.579616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d03035-757b-431a-a199-909884b32aab None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.612804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7da4f9-521d-41b8-9b05-ca88613ec696 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.615525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abc5d-f71e-4a71-9c42-3e3592b6051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:39.616566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abc5d-f71e-4a71-9c42-3e3592b6051e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:39.617088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abc5d-f71e-4a71-9c42-3e3592b6051e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:39.617566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abc5d-f71e-4a71-9c42-3e3592b6051e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:39.627913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:39.630960 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4abc5d-f71e-4a71-9c42-3e3592b6051e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:39.632659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4abc5d-f71e-4a71-9c42-3e3592b6051e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:39.648721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba388b0d-09bc-4b8e-9916-85fab7b71840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:39.649426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba388b0d-09bc-4b8e-9916-85fab7b71840 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:39.649711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba388b0d-09bc-4b8e-9916-85fab7b71840 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:39.650025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba388b0d-09bc-4b8e-9916-85fab7b71840 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:39.650738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba388b0d-09bc-4b8e-9916-85fab7b71840 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:39.651048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba388b0d-09bc-4b8e-9916-85fab7b71840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:39.652414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba388b0d-09bc-4b8e-9916-85fab7b71840 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-0e4abc5d-f71e-4a71-9c42-3e3592b6051e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:39.653149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:39.654056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:39.655107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:39.655107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:39.655107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:39.655107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:39.662818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 445/885] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:39.663110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 441/886] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:39.663202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba388b0d-09bc-4b8e-9916-85fab7b71840 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.663807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abc5d-f71e-4a71-9c42-3e3592b6051e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.697076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:39.788962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abc5d-f71e-4a71-9c42-3e3592b6051e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.791728 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba388b0d-09bc-4b8e-9916-85fab7b71840 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.830522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420cf61-2cd1-4d2a-aec6-67ae1a224d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:39.831511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420cf61-2cd1-4d2a-aec6-67ae1a224d82 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:39.831947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420cf61-2cd1-4d2a-aec6-67ae1a224d82 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:39.832374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420cf61-2cd1-4d2a-aec6-67ae1a224d82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:39.833378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420cf61-2cd1-4d2a-aec6-67ae1a224d82 None admin] RBAC: Adding query filter params (interface=public, service_id=2f53ae5fb2b14079a95d2fb392738f50, region_id=RegionOne) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:39.833867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420cf61-2cd1-4d2a-aec6-67ae1a224d82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:39.835468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420cf61-2cd1-4d2a-aec6-67ae1a224d82 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:39.839896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec37cf4-5c95-4314-b661-8a25605dcaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:39.840878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec37cf4-5c95-4314-b661-8a25605dcaeb None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:39.841171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec37cf4-5c95-4314-b661-8a25605dcaeb None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:39.841449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec37cf4-5c95-4314-b661-8a25605dcaeb None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:39.842248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec37cf4-5c95-4314-b661-8a25605dcaeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:39.842560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec37cf4-5c95-4314-b661-8a25605dcaeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:39.843590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 442/887] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/endpoints?service_id=2f53ae5fb2b14079a95d2fb392738f50&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:39.844058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec37cf4-5c95-4314-b661-8a25605dcaeb None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:39.849719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420cf61-2cd1-4d2a-aec6-67ae1a224d82 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.861837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 446/888] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:39.870047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec37cf4-5c95-4314-b661-8a25605dcaeb None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:39.916020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:39.940584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:39.955414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420cf61-2cd1-4d2a-aec6-67ae1a224d82 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.982323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec37cf4-5c95-4314-b661-8a25605dcaeb None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:39.990494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9a4bc-12e4-408f-af1b-793264ae953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:39.991461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9a4bc-12e4-408f-af1b-793264ae953a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:39.991461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9a4bc-12e4-408f-af1b-793264ae953a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:39.991730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9a4bc-12e4-408f-af1b-793264ae953a None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:39.992486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9a4bc-12e4-408f-af1b-793264ae953a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:39.994214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9a4bc-12e4-408f-af1b-793264ae953a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:40.000204 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 443/889] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:33:40.028485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568ae2a-ab7f-405c-9de0-555fce74270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:40.029569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568ae2a-ab7f-405c-9de0-555fce74270b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.030073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568ae2a-ab7f-405c-9de0-555fce74270b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.030511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568ae2a-ab7f-405c-9de0-555fce74270b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.039430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568ae2a-ab7f-405c-9de0-555fce74270b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:40.041726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568ae2a-ab7f-405c-9de0-555fce74270b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-3568ae2a-ab7f-405c-9de0-555fce74270b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:40.058824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:40.060009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:40.061151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:40.063640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 447/890] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:33:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:40.071993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9a4bc-12e4-408f-af1b-793264ae953a None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:40.178346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9a4bc-12e4-408f-af1b-793264ae953a None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:40.212496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c483-095d-40d4-b37a-ea295c17d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:40.213227 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c483-095d-40d4-b37a-ea295c17d30c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.213513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c483-095d-40d4-b37a-ea295c17d30c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.213841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c483-095d-40d4-b37a-ea295c17d30c None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.214725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c483-095d-40d4-b37a-ea295c17d30c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:40.215037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c483-095d-40d4-b37a-ea295c17d30c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:40.216467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c483-095d-40d4-b37a-ea295c17d30c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:40.235149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 444/891] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 10:33:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:40.240791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568ae2a-ab7f-405c-9de0-555fce74270b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:40.254143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084d48-86d5-4a1f-9184-fad70d826eae None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.254423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084d48-86d5-4a1f-9184-fad70d826eae None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.254706 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084d48-86d5-4a1f-9184-fad70d826eae None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.256338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 445/892] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:33:40.264580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58afa3-f38c-4ab9-b535-8d0cbb0b1789 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.264871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58afa3-f38c-4ab9-b535-8d0cbb0b1789 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.265153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58afa3-f38c-4ab9-b535-8d0cbb0b1789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.287760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3c58afa3-f38c-4ab9-b535-8d0cbb0b1789 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:40.288956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3c58afa3-f38c-4ab9-b535-8d0cbb0b1789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:40.291043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:40.357028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:40.361874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568ae2a-ab7f-405c-9de0-555fce74270b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:40.389032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 446/893] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:40.406598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff28c-baed-4611-8eb2-d76b99f12549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:40.407248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff28c-baed-4611-8eb2-d76b99f12549 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.407532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff28c-baed-4611-8eb2-d76b99f12549 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.407889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff28c-baed-4611-8eb2-d76b99f12549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.414522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58afa3-f38c-4ab9-b535-8d0cbb0b1789 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:40.481853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ff28c-baed-4611-8eb2-d76b99f12549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:40.483322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ff28c-baed-4611-8eb2-d76b99f12549 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:40.519363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58afa3-f38c-4ab9-b535-8d0cbb0b1789 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:40.555170 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d70a79-4e3f-458e-a35d-312ed53aad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:40.556443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70a79-4e3f-458e-a35d-312ed53aad1a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.556944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70a79-4e3f-458e-a35d-312ed53aad1a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.557423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70a79-4e3f-458e-a35d-312ed53aad1a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.558318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d70a79-4e3f-458e-a35d-312ed53aad1a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:40.559952 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d70a79-4e3f-458e-a35d-312ed53aad1a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-f0d70a79-4e3f-458e-a35d-312ed53aad1a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:40.572677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:40.573721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:33:40.574597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:40.582135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 447/894] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:33:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:40.583214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d70a79-4e3f-458e-a35d-312ed53aad1a None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:40.586093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:40.590941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:40.600546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 448/895] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:40 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:40.601811 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff28c-baed-4611-8eb2-d76b99f12549 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:40.710701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff28c-baed-4611-8eb2-d76b99f12549 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:40.712608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d70a79-4e3f-458e-a35d-312ed53aad1a None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:40.747397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751feae9-17e7-4ad4-aaf1-52c71770fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:40.748110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751feae9-17e7-4ad4-aaf1-52c71770fe2b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.748409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751feae9-17e7-4ad4-aaf1-52c71770fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.748688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751feae9-17e7-4ad4-aaf1-52c71770fe2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.750618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956352-8cab-486f-b04e-3348c25ccc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:40.751535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956352-8cab-486f-b04e-3348c25ccc84 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.752021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956352-8cab-486f-b04e-3348c25ccc84 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.752494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956352-8cab-486f-b04e-3348c25ccc84 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.753421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea956352-8cab-486f-b04e-3348c25ccc84 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:40.753929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea956352-8cab-486f-b04e-3348c25ccc84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:40.755589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea956352-8cab-486f-b04e-3348c25ccc84 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:40.760004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751feae9-17e7-4ad4-aaf1-52c71770fe2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:40.765573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751feae9-17e7-4ad4-aaf1-52c71770fe2b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:40.765732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 448/896] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:33:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:40.766859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956352-8cab-486f-b04e-3348c25ccc84 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-751feae9-17e7-4ad4-aaf1-52c71770fe2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:40.785474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:40.786469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:40.787470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:40.787470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:40.787470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:40.787470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:40.787470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 449/897] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:40.788537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff236-4186-46b3-b1d2-c05037bb35f8 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.788537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff236-4186-46b3-b1d2-c05037bb35f8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.788537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff236-4186-46b3-b1d2-c05037bb35f8 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.790647 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 450/898] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:40.792612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeff236-4186-46b3-b1d2-c05037bb35f8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:40.848359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:40.852852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:40.882821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956352-8cab-486f-b04e-3348c25ccc84 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:40.919565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeff236-4186-46b3-b1d2-c05037bb35f8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:40.922761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef573d-badf-4149-be89-d1fc693e0f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:40.923434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef573d-badf-4149-be89-d1fc693e0f66 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.923723 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef573d-badf-4149-be89-d1fc693e0f66 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.924004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef573d-badf-4149-be89-d1fc693e0f66 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.924717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef573d-badf-4149-be89-d1fc693e0f66 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:40.925028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef573d-badf-4149-be89-d1fc693e0f66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:40.926471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef573d-badf-4149-be89-d1fc693e0f66 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:40.936067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 449/899] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:33:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:40.936067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619b19-d586-4931-bcf9-0aabe6234107 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.936067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619b19-d586-4931-bcf9-0aabe6234107 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.936067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619b19-d586-4931-bcf9-0aabe6234107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.949454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ec619b19-d586-4931-bcf9-0aabe6234107 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:40.950676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ec619b19-d586-4931-bcf9-0aabe6234107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:40.963994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e30055-8144-450a-b161-28e5581769ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:40.964705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e30055-8144-450a-b161-28e5581769ce None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:40.965005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e30055-8144-450a-b161-28e5581769ce None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:40.965286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e30055-8144-450a-b161-28e5581769ce None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:40.966050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e30055-8144-450a-b161-28e5581769ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:40.966367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e30055-8144-450a-b161-28e5581769ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:40.967801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e30055-8144-450a-b161-28e5581769ce None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:40.981578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 451/900] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:40.981578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e30055-8144-450a-b161-28e5581769ce None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:41.030336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 450/901] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:41.032389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619b19-d586-4931-bcf9-0aabe6234107 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:41.090891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e30055-8144-450a-b161-28e5581769ce None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:41.098288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:41.102772 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:41.129616 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2bff9-de1b-430f-848f-7062bf33ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:41.130541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2bff9-de1b-430f-848f-7062bf33ded0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:41.130981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2bff9-de1b-430f-848f-7062bf33ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:41.131264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2bff9-de1b-430f-848f-7062bf33ded0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:41.132056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2bff9-de1b-430f-848f-7062bf33ded0 None admin] RBAC: Adding query filter params (interface=public, service_id=1898f12ff26241598fb357dcadae6db0, region_id=RegionOne) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:41.134770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2bff9-de1b-430f-848f-7062bf33ded0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:41.134770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2bff9-de1b-430f-848f-7062bf33ded0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:41.141469 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619b19-d586-4931-bcf9-0aabe6234107 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:41.147812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 452/902] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 10:33:40 2022] GET /identity/v3/endpoints?service_id=1898f12ff26241598fb357dcadae6db0&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:41.147812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2bff9-de1b-430f-848f-7062bf33ded0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:41.178526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d4674-2eb0-40b1-a82c-245189b5dcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:41.179334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d4674-2eb0-40b1-a82c-245189b5dcfd None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:41.179625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d4674-2eb0-40b1-a82c-245189b5dcfd None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:41.179898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d4674-2eb0-40b1-a82c-245189b5dcfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:41.186805 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d4674-2eb0-40b1-a82c-245189b5dcfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:41.188236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d4674-2eb0-40b1-a82c-245189b5dcfd None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-7c6d4674-2eb0-40b1-a82c-245189b5dcfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:41.202378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:41.203416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 451/903] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:41.204477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d4674-2eb0-40b1-a82c-245189b5dcfd None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:41.263711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2bff9-de1b-430f-848f-7062bf33ded0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:41.301920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b428c8d-9d0a-4d63-a10d-143425f358c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:41.303011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428c8d-9d0a-4d63-a10d-143425f358c3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:41.303291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428c8d-9d0a-4d63-a10d-143425f358c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:41.303569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428c8d-9d0a-4d63-a10d-143425f358c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:41.304231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b428c8d-9d0a-4d63-a10d-143425f358c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:41.305714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b428c8d-9d0a-4d63-a10d-143425f358c3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:41.312738 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d4674-2eb0-40b1-a82c-245189b5dcfd None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1b428c8d-9d0a-4d63-a10d-143425f358c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:41.318326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:41.319324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:41.322974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 453/904] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:41.323972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b428c8d-9d0a-4d63-a10d-143425f358c3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:41.341027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:41.356060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095c2b-5e17-4926-a7ce-089f94259a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:41.356719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095c2b-5e17-4926-a7ce-089f94259a8d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:41.357001 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095c2b-5e17-4926-a7ce-089f94259a8d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:41.357278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095c2b-5e17-4926-a7ce-089f94259a8d None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:41.357984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b095c2b-5e17-4926-a7ce-089f94259a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:41.359335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b095c2b-5e17-4926-a7ce-089f94259a8d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:41.365230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 452/905] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 10:33:41 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:33:41.366019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095c2b-5e17-4926-a7ce-089f94259a8d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:41.366297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:41.454211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b428c8d-9d0a-4d63-a10d-143425f358c3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:41.494376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aafe0d-3a5a-4727-83bd-3658522ade46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:41.495442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aafe0d-3a5a-4727-83bd-3658522ade46 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:41.495567 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aafe0d-3a5a-4727-83bd-3658522ade46 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:41.495934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aafe0d-3a5a-4727-83bd-3658522ade46 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:41.496843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aafe0d-3a5a-4727-83bd-3658522ade46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:41.497262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aafe0d-3a5a-4727-83bd-3658522ade46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:41.498864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aafe0d-3a5a-4727-83bd-3658522ade46 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:41.502861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095c2b-5e17-4926-a7ce-089f94259a8d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:41.514941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 454/906] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:41.520952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aafe0d-3a5a-4727-83bd-3658522ade46 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:41.543108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c4f34-b019-4408-ac4f-6c09b3e6e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:41.544019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c4f34-b019-4408-ac4f-6c09b3e6e055 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:41.544483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c4f34-b019-4408-ac4f-6c09b3e6e055 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:41.545028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c4f34-b019-4408-ac4f-6c09b3e6e055 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:41.546446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c4f34-b019-4408-ac4f-6c09b3e6e055 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:41.546912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c4f34-b019-4408-ac4f-6c09b3e6e055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:41.548722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c4f34-b019-4408-ac4f-6c09b3e6e055 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:41.554493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 453/907] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:41.560499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c4f34-b019-4408-ac4f-6c09b3e6e055 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:41.629611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:41.641775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:41.646130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aafe0d-3a5a-4727-83bd-3658522ade46 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:41.682348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f86ba2-3c8e-46e6-90cb-b46814974d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:41.683384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86ba2-3c8e-46e6-90cb-b46814974d94 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:41.683930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86ba2-3c8e-46e6-90cb-b46814974d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:41.684429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86ba2-3c8e-46e6-90cb-b46814974d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:41.685462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f86ba2-3c8e-46e6-90cb-b46814974d94 None admin] RBAC: Adding query filter params (role.id=f8e83f8093fd4211ba9af2015d7f0fa1, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=25df9d4438a34863bbde92da4be8c0df) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:41.686002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f86ba2-3c8e-46e6-90cb-b46814974d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:41.687656 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f86ba2-3c8e-46e6-90cb-b46814974d94 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:41.698553 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c4f34-b019-4408-ac4f-6c09b3e6e055 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:41.698903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 455/908] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:41 2022] GET /identity/v3/role_assignments?user.id=25df9d4438a34863bbde92da4be8c0df&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=f8e83f8093fd4211ba9af2015d7f0fa1 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:41.740721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca25e4-928b-43af-96d4-d8773ab8862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:41.741406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca25e4-928b-43af-96d4-d8773ab8862e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:41.741697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca25e4-928b-43af-96d4-d8773ab8862e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:41.741998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca25e4-928b-43af-96d4-d8773ab8862e None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:41.742767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca25e4-928b-43af-96d4-d8773ab8862e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:41.743079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca25e4-928b-43af-96d4-d8773ab8862e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:41.744476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca25e4-928b-43af-96d4-d8773ab8862e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:41.750377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 454/909] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:42.093306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d46dc-10ce-4084-b64e-3d98687c088d None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:42.093679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d46dc-10ce-4084-b64e-3d98687c088d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:42.093857 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d46dc-10ce-4084-b64e-3d98687c088d None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:42.095498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 456/910] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:42.101081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785c0b-5900-4b5a-9f6b-ce862de2e2f6 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:42.101542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785c0b-5900-4b5a-9f6b-ce862de2e2f6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:42.101618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785c0b-5900-4b5a-9f6b-ce862de2e2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:42.119349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9d785c0b-5900-4b5a-9f6b-ce862de2e2f6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:42.120521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9d785c0b-5900-4b5a-9f6b-ce862de2e2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:42.195198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 455/911] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:42.219435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d46dc-10ce-4084-b64e-3d98687c088d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:42.329922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d46dc-10ce-4084-b64e-3d98687c088d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:42.368665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4a7a-09a9-4090-b107-accae3cda745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:42.369483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4a7a-09a9-4090-b107-accae3cda745 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:42.369772 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4a7a-09a9-4090-b107-accae3cda745 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:42.370079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4a7a-09a9-4090-b107-accae3cda745 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:42.370745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b4a7a-09a9-4090-b107-accae3cda745 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:42.372118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b4a7a-09a9-4090-b107-accae3cda745 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-485b4a7a-09a9-4090-b107-accae3cda745 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:42.384697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:42.385615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:42.386489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 457/912] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jun 30 10:33:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:42.391944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785c0b-5900-4b5a-9f6b-ce862de2e2f6 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:42.442330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:42.500009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785c0b-5900-4b5a-9f6b-ce862de2e2f6 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:42.537708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5630b-2b81-4b78-a6dc-0ef213939bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:42.538419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5630b-2b81-4b78-a6dc-0ef213939bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:42.538711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5630b-2b81-4b78-a6dc-0ef213939bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:42.538994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5630b-2b81-4b78-a6dc-0ef213939bc1 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:42.539757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5630b-2b81-4b78-a6dc-0ef213939bc1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:42.540069 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5630b-2b81-4b78-a6dc-0ef213939bc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:42.541443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5630b-2b81-4b78-a6dc-0ef213939bc1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:42.546663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 456/913] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:42.552270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4a7a-09a9-4090-b107-accae3cda745 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:42.582287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:42.672281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4a7a-09a9-4090-b107-accae3cda745 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:42.707375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821c914-2a3c-41ae-b1c0-49dcc0e1489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:42.708345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821c914-2a3c-41ae-b1c0-49dcc0e1489f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:42.708842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821c914-2a3c-41ae-b1c0-49dcc0e1489f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:42.709342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821c914-2a3c-41ae-b1c0-49dcc0e1489f None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:42.710285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821c914-2a3c-41ae-b1c0-49dcc0e1489f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:42.710798 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821c914-2a3c-41ae-b1c0-49dcc0e1489f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:42.712983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821c914-2a3c-41ae-b1c0-49dcc0e1489f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:42.718513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 458/914] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:42.729972 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5630b-2b81-4b78-a6dc-0ef213939bc1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:42.825758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5630b-2b81-4b78-a6dc-0ef213939bc1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:42.833176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:42.863255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaba17-e2e4-4768-916d-1843b4ef8e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:42.863932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaba17-e2e4-4768-916d-1843b4ef8e42 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:42.864222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaba17-e2e4-4768-916d-1843b4ef8e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:42.864504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaba17-e2e4-4768-916d-1843b4ef8e42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:42.865278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaba17-e2e4-4768-916d-1843b4ef8e42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:42.866703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaba17-e2e4-4768-916d-1843b4ef8e42 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:42.954904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 457/915] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 10:33:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:43.466678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab738-3ec4-412a-bfe7-a776e84ba7d7 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:43.467702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab738-3ec4-412a-bfe7-a776e84ba7d7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:43.468210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab738-3ec4-412a-bfe7-a776e84ba7d7 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:43.470078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 459/916] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:43.476081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878745c-28ce-4451-a78b-a88bd68a5772 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:43.476578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878745c-28ce-4451-a78b-a88bd68a5772 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:43.476655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878745c-28ce-4451-a78b-a88bd68a5772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:43.496327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b878745c-28ce-4451-a78b-a88bd68a5772 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:43.497517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b878745c-28ce-4451-a78b-a88bd68a5772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:43.574240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 458/917] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:43.596729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab738-3ec4-412a-bfe7-a776e84ba7d7 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:43.696868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:43.712051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab738-3ec4-412a-bfe7-a776e84ba7d7 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:43.748124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102cf5e-2d8e-482d-aede-88bec3bb1285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:43.749248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102cf5e-2d8e-482d-aede-88bec3bb1285 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:43.749770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102cf5e-2d8e-482d-aede-88bec3bb1285 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:43.750295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102cf5e-2d8e-482d-aede-88bec3bb1285 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:43.751156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102cf5e-2d8e-482d-aede-88bec3bb1285 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:43.752747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102cf5e-2d8e-482d-aede-88bec3bb1285 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-3102cf5e-2d8e-482d-aede-88bec3bb1285 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:43.765106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:43.766124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:33:43.766980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:43.769811 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 460/918] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:33:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:43.778186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878745c-28ce-4451-a78b-a88bd68a5772 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:43.826084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b837e-bbe6-4b96-90cd-70626dae2792 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:43.826427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b837e-bbe6-4b96-90cd-70626dae2792 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:43.826652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b837e-bbe6-4b96-90cd-70626dae2792 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:43.828344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 461/919] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:43.833371 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad80a-1b64-42b1-b538-91197c74a10f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:43.833658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad80a-1b64-42b1-b538-91197c74a10f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:43.833949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad80a-1b64-42b1-b538-91197c74a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:43.855899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-5d2ad80a-1b64-42b1-b538-91197c74a10f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:43.857120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5d2ad80a-1b64-42b1-b538-91197c74a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:43.879384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:43.904148 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878745c-28ce-4451-a78b-a88bd68a5772 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:43.936193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 462/920] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:43.937839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182ede8-ea51-4663-b159-dfe18a2d30b1 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:43.938158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182ede8-ea51-4663-b159-dfe18a2d30b1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:43.938436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182ede8-ea51-4663-b159-dfe18a2d30b1 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:43.939850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 463/921] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:43.944832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801c60-4980-487f-9f5d-647ace7f6aa6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:43.945129 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801c60-4980-487f-9f5d-647ace7f6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:43.945381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c8f0-4bb7-46c9-b334-857268d64796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:43.945517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801c60-4980-487f-9f5d-647ace7f6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:43.946450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c8f0-4bb7-46c9-b334-857268d64796 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:43.947106 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c8f0-4bb7-46c9-b334-857268d64796 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:43.947602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c8f0-4bb7-46c9-b334-857268d64796 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:43.948511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47c8f0-4bb7-46c9-b334-857268d64796 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:43.949022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47c8f0-4bb7-46c9-b334-857268d64796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:43.950670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47c8f0-4bb7-46c9-b334-857268d64796 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:43.962941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 459/922] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:33:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:43.962941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c8f0-4bb7-46c9-b334-857268d64796 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:43.967110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-dd801c60-4980-487f-9f5d-647ace7f6aa6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:43.968302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-dd801c60-4980-487f-9f5d-647ace7f6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:44.043601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 464/923] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:44.044448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801c60-4980-487f-9f5d-647ace7f6aa6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:44.066200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:44.079353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c8f0-4bb7-46c9-b334-857268d64796 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:44.119201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac648-06da-47e2-8900-d9bf1a748368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:44.120509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac648-06da-47e2-8900-d9bf1a748368 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:44.121570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac648-06da-47e2-8900-d9bf1a748368 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:44.122086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac648-06da-47e2-8900-d9bf1a748368 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:44.135680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ac648-06da-47e2-8900-d9bf1a748368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-736ac648-06da-47e2-8900-d9bf1a748368 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:44.146206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:44.147120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:33:44.147937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:44.151242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 460/924] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 10:33:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:44.152752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac648-06da-47e2-8900-d9bf1a748368 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:44.157022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801c60-4980-487f-9f5d-647ace7f6aa6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:44.170798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:44.194197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784891d-be94-4aee-8915-3b21184ce2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:44.194858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784891d-be94-4aee-8915-3b21184ce2ac None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:44.195169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784891d-be94-4aee-8915-3b21184ce2ac None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:44.195449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784891d-be94-4aee-8915-3b21184ce2ac None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:44.196685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784891d-be94-4aee-8915-3b21184ce2ac None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:44.196991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784891d-be94-4aee-8915-3b21184ce2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:44.198395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784891d-be94-4aee-8915-3b21184ce2ac None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:44.203540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 465/925] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jun 30 10:33:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:44.204433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784891d-be94-4aee-8915-3b21184ce2ac None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:44.265234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac648-06da-47e2-8900-d9bf1a748368 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:44.284207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:44.300727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f532ae-abe9-4cce-9132-0f133ba5b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:44.301626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f532ae-abe9-4cce-9132-0f133ba5b1d5 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:44.302118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f532ae-abe9-4cce-9132-0f133ba5b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:44.302575 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f532ae-abe9-4cce-9132-0f133ba5b1d5 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:44.303462 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f532ae-abe9-4cce-9132-0f133ba5b1d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:44.304892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784891d-be94-4aee-8915-3b21184ce2ac None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:44.305306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f532ae-abe9-4cce-9132-0f133ba5b1d5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:44.339535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378afef-61e8-4cb3-967d-15af38aed9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:44.340220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378afef-61e8-4cb3-967d-15af38aed9bf None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:44.340502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378afef-61e8-4cb3-967d-15af38aed9bf None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:44.340827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378afef-61e8-4cb3-967d-15af38aed9bf None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:44.341548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378afef-61e8-4cb3-967d-15af38aed9bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:44.341855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378afef-61e8-4cb3-967d-15af38aed9bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:44.343246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378afef-61e8-4cb3-967d-15af38aed9bf None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:44.351251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 466/926] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 10:33:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:44.352019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378afef-61e8-4cb3-967d-15af38aed9bf None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:44.371835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 461/927] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:33:44 2022] POST /identity/v3/services => generated 241 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:44.372774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f532ae-abe9-4cce-9132-0f133ba5b1d5 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:44.480341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:44.482367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378afef-61e8-4cb3-967d-15af38aed9bf None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:44.529310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b3ddb-4810-48bc-b916-e9bed454fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:44.530013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b3ddb-4810-48bc-b916-e9bed454fc8f None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:44.530304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b3ddb-4810-48bc-b916-e9bed454fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:44.530583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b3ddb-4810-48bc-b916-e9bed454fc8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:44.531332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b3ddb-4810-48bc-b916-e9bed454fc8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:44.532731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b3ddb-4810-48bc-b916-e9bed454fc8f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:44.534090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f532ae-abe9-4cce-9132-0f133ba5b1d5 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:44.538153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:44.576964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d753dd-8f9a-487a-815e-1d146da08b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:44.577739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d753dd-8f9a-487a-815e-1d146da08b54 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:44.578060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d753dd-8f9a-487a-815e-1d146da08b54 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:44.578386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d753dd-8f9a-487a-815e-1d146da08b54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:44.589532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d753dd-8f9a-487a-815e-1d146da08b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:44.591086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d753dd-8f9a-487a-815e-1d146da08b54 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-46d753dd-8f9a-487a-815e-1d146da08b54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:44.610867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:44.618466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:44.619417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:44.619417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:44.619417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:44.619417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:44.619417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 462/928] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:44.619417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d753dd-8f9a-487a-815e-1d146da08b54 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:44.642999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 467/929] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 10:33:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:44.745006 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d753dd-8f9a-487a-815e-1d146da08b54 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:44.767616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:44.790101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b2c8c-8fea-4d58-b2a0-fa26099a9786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:44.790788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b2c8c-8fea-4d58-b2a0-fa26099a9786 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:44.791077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b2c8c-8fea-4d58-b2a0-fa26099a9786 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:44.791360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b2c8c-8fea-4d58-b2a0-fa26099a9786 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:44.792096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b2c8c-8fea-4d58-b2a0-fa26099a9786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:44.792408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b2c8c-8fea-4d58-b2a0-fa26099a9786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:44.793833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b2c8c-8fea-4d58-b2a0-fa26099a9786 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:44.808276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 463/930] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:44.814457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b3ddb-4810-48bc-b916-e9bed454fc8f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:44.932185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b3ddb-4810-48bc-b916-e9bed454fc8f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:44.967654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcb61c-abcd-4608-a2e9-25a0b95e92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:44.968823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcb61c-abcd-4608-a2e9-25a0b95e92da None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:44.969336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcb61c-abcd-4608-a2e9-25a0b95e92da None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:44.969816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcb61c-abcd-4608-a2e9-25a0b95e92da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:44.979012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcb61c-abcd-4608-a2e9-25a0b95e92da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:44.980717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcb61c-abcd-4608-a2e9-25a0b95e92da None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-cbfcb61c-abcd-4608-a2e9-25a0b95e92da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:44.996328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:44.997355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:44.998327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:45.000998 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 468/931] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:33:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:45.006887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b2c8c-8fea-4d58-b2a0-fa26099a9786 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:45.013251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f23fe3-e4f2-448a-a019-2f3d2081345c None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.013806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f23fe3-e4f2-448a-a019-2f3d2081345c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.014316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f23fe3-e4f2-448a-a019-2f3d2081345c None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.016112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 469/932] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:45.022971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee9fb-1dce-4803-ab66-50dcbd249eb6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.023259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee9fb-1dce-4803-ab66-50dcbd249eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.023538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee9fb-1dce-4803-ab66-50dcbd249eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.046235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-9c7ee9fb-1dce-4803-ab66-50dcbd249eb6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:45.048273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9c7ee9fb-1dce-4803-ab66-50dcbd249eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:45.113586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:45.121469 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b2c8c-8fea-4d58-b2a0-fa26099a9786 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:45.150162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 470/933] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:45.163864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b70b94-51c1-459b-9f0d-e5a07b23af34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:45.165162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b70b94-51c1-459b-9f0d-e5a07b23af34 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.165495 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b70b94-51c1-459b-9f0d-e5a07b23af34 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.170234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b70b94-51c1-459b-9f0d-e5a07b23af34 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.170234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b70b94-51c1-459b-9f0d-e5a07b23af34 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:45.170234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b70b94-51c1-459b-9f0d-e5a07b23af34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:45.170234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b70b94-51c1-459b-9f0d-e5a07b23af34 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:45.174588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ee9fb-1dce-4803-ab66-50dcbd249eb6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:45.193989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 464/934] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 10:33:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:45.198719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b70b94-51c1-459b-9f0d-e5a07b23af34 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:45.234117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:45.301493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b70b94-51c1-459b-9f0d-e5a07b23af34 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:45.310291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ee9fb-1dce-4803-ab66-50dcbd249eb6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:45.339631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6ce52-8907-48ad-b1a0-305d1b237c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:45.340425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ce52-8907-48ad-b1a0-305d1b237c9f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.340712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ce52-8907-48ad-b1a0-305d1b237c9f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.340993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ce52-8907-48ad-b1a0-305d1b237c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.352955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6ce52-8907-48ad-b1a0-305d1b237c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:45.354475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6ce52-8907-48ad-b1a0-305d1b237c9f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:45.358401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b48b7-2ddd-41c0-b653-d3c7854f0308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:45.359442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b48b7-2ddd-41c0-b653-d3c7854f0308 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.359930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b48b7-2ddd-41c0-b653-d3c7854f0308 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.360425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b48b7-2ddd-41c0-b653-d3c7854f0308 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.361790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b48b7-2ddd-41c0-b653-d3c7854f0308 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:45.363907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b48b7-2ddd-41c0-b653-d3c7854f0308 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-afa6ce52-8907-48ad-b1a0-305d1b237c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:45.372489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:45.373352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:45.374274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:45.374274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:45.374274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:45.374274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:45.378298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 465/935] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-7c8b48b7-2ddd-41c0-b653-d3c7854f0308 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:45.378910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:45.380076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:33:45.381026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:45.381775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6ce52-8907-48ad-b1a0-305d1b237c9f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:45.383375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 471/936] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:45.388983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b48b7-2ddd-41c0-b653-d3c7854f0308 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:45.462124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:45.476773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:45.492422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6ce52-8907-48ad-b1a0-305d1b237c9f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:45.532209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b184064-ce3c-40bf-a05e-f1d2364596e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:45.532867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184064-ce3c-40bf-a05e-f1d2364596e8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.533153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184064-ce3c-40bf-a05e-f1d2364596e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.533432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184064-ce3c-40bf-a05e-f1d2364596e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.534257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b184064-ce3c-40bf-a05e-f1d2364596e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:45.534573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b184064-ce3c-40bf-a05e-f1d2364596e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:45.535645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b48b7-2ddd-41c0-b653-d3c7854f0308 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:45.536078 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b184064-ce3c-40bf-a05e-f1d2364596e8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:45.554295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 466/937] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:45.555500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b184064-ce3c-40bf-a05e-f1d2364596e8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:45.575614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b56a-68d0-49be-b398-4aef05c64016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:45.576736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b56a-68d0-49be-b398-4aef05c64016 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.577226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b56a-68d0-49be-b398-4aef05c64016 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.577735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b56a-68d0-49be-b398-4aef05c64016 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.578671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66b56a-68d0-49be-b398-4aef05c64016 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:45.579183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66b56a-68d0-49be-b398-4aef05c64016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:45.580801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66b56a-68d0-49be-b398-4aef05c64016 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:45.587204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 472/938] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:45.592875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b56a-68d0-49be-b398-4aef05c64016 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:45.677664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b184064-ce3c-40bf-a05e-f1d2364596e8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:45.708317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b56a-68d0-49be-b398-4aef05c64016 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:45.721659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:45.724822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8b9c-2885-4807-bbd5-da573b7b4cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:45.726095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8b9c-2885-4807-bbd5-da573b7b4cb7 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.726587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8b9c-2885-4807-bbd5-da573b7b4cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.727098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8b9c-2885-4807-bbd5-da573b7b4cb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.734351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d8b9c-2885-4807-bbd5-da573b7b4cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:45.736022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d8b9c-2885-4807-bbd5-da573b7b4cb7 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:45.749961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1109c2-51c1-4329-9a60-5f83bfd53573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:45.750689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1109c2-51c1-4329-9a60-5f83bfd53573 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.750976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1109c2-51c1-4329-9a60-5f83bfd53573 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.751350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1109c2-51c1-4329-9a60-5f83bfd53573 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-913d8b9c-2885-4807-bbd5-da573b7b4cb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:45.752046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:45.752894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:45.753777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:45.753777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:45.753777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:45.753777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:45.753777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:45.753777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:45.753777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:45.753777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:45.754233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1109c2-51c1-4329-9a60-5f83bfd53573 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:45.754233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1109c2-51c1-4329-9a60-5f83bfd53573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:45.754233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1109c2-51c1-4329-9a60-5f83bfd53573 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:45.756172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 467/939] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:45.765980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 473/940] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:45.767054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8b9c-2885-4807-bbd5-da573b7b4cb7 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:45.780088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:45.880039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8b9c-2885-4807-bbd5-da573b7b4cb7 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:45.919294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f04f9-7060-45bb-bc16-b5af6e94b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:45.919989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f04f9-7060-45bb-bc16-b5af6e94b2da None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.920278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f04f9-7060-45bb-bc16-b5af6e94b2da None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.920560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f04f9-7060-45bb-bc16-b5af6e94b2da None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.921465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f04f9-7060-45bb-bc16-b5af6e94b2da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:45.921831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f04f9-7060-45bb-bc16-b5af6e94b2da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:45.923396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f04f9-7060-45bb-bc16-b5af6e94b2da None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:45.937555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 468/941] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:45.943419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1109c2-51c1-4329-9a60-5f83bfd53573 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:46.048509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1109c2-51c1-4329-9a60-5f83bfd53573 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:46.084187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde14d10-a86e-4af1-82ba-109e8cea6aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:46.085079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14d10-a86e-4af1-82ba-109e8cea6aaf None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:46.085365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14d10-a86e-4af1-82ba-109e8cea6aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:46.085650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14d10-a86e-4af1-82ba-109e8cea6aaf None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/25df9d4438a34863bbde92da4be8c0df/roles/f8e83f8093fd4211ba9af2015d7f0fa1` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:46.087948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde14d10-a86e-4af1-82ba-109e8cea6aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=25df9d4438a34863bbde92da4be8c0df, role_id=f8e83f8093fd4211ba9af2015d7f0fa1)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:46.089396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde14d10-a86e-4af1-82ba-109e8cea6aaf None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:46.163189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 474/942] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:33:45 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/25df9d4438a34863bbde92da4be8c0df/roles/f8e83f8093fd4211ba9af2015d7f0fa1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:33:46.512351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1fb19-6eea-4b15-bac0-cae6e728aaad None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:46.513451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1fb19-6eea-4b15-bac0-cae6e728aaad None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:46.513994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1fb19-6eea-4b15-bac0-cae6e728aaad None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:46.515857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 469/943] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:46.521424 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b616706-4ad9-4776-834a-e5cc151ec783 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:46.522016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b616706-4ad9-4776-834a-e5cc151ec783 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:46.522541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b616706-4ad9-4776-834a-e5cc151ec783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:46.540319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7b616706-4ad9-4776-834a-e5cc151ec783 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:46.542326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7b616706-4ad9-4776-834a-e5cc151ec783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:46.571863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:46.614382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 475/944] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:46.639797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1fb19-6eea-4b15-bac0-cae6e728aaad None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:46.713192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:46.756465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1fb19-6eea-4b15-bac0-cae6e728aaad None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:46.794012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7be50d-1ab0-4e14-8b57-67c1a628faab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:46.795239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7be50d-1ab0-4e14-8b57-67c1a628faab None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:46.795745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7be50d-1ab0-4e14-8b57-67c1a628faab None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:46.796248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7be50d-1ab0-4e14-8b57-67c1a628faab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:46.797119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7be50d-1ab0-4e14-8b57-67c1a628faab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:46.798779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7be50d-1ab0-4e14-8b57-67c1a628faab None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-2a7be50d-1ab0-4e14-8b57-67c1a628faab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:46.811836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:46.812925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:46.813840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:46.816797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 470/945] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:46.823633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b616706-4ad9-4776-834a-e5cc151ec783 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:46.855336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e2728-9fc6-4439-9b29-638834d6af2a None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:46.855675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e2728-9fc6-4439-9b29-638834d6af2a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:46.855916 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e2728-9fc6-4439-9b29-638834d6af2a None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:46.857435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 471/946] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:46.862572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857742-f42d-447c-b3f6-d75ed648b42f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:46.863111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857742-f42d-447c-b3f6-d75ed648b42f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:46.863630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857742-f42d-447c-b3f6-d75ed648b42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:46.881332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9c857742-f42d-447c-b3f6-d75ed648b42f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:46.882828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9c857742-f42d-447c-b3f6-d75ed648b42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:46.951892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b616706-4ad9-4776-834a-e5cc151ec783 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:46.982100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 472/947] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:47.000205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243c26-f9d1-49d7-baa8-7e1d038facce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:47.000923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243c26-f9d1-49d7-baa8-7e1d038facce None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:47.001215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243c26-f9d1-49d7-baa8-7e1d038facce None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:47.001497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243c26-f9d1-49d7-baa8-7e1d038facce None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:47.002249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243c26-f9d1-49d7-baa8-7e1d038facce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:47.002562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243c26-f9d1-49d7-baa8-7e1d038facce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:47.004834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c857742-f42d-447c-b3f6-d75ed648b42f None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:47.006178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243c26-f9d1-49d7-baa8-7e1d038facce None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:47.012569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 476/948] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:47.017812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243c26-f9d1-49d7-baa8-7e1d038facce None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:47.049621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:47.079714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:47.130952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243c26-f9d1-49d7-baa8-7e1d038facce None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:47.136467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c857742-f42d-447c-b3f6-d75ed648b42f None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:47.165909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71827ca-d721-4577-bc5f-6cfc13057606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:47.166620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71827ca-d721-4577-bc5f-6cfc13057606 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:47.166911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71827ca-d721-4577-bc5f-6cfc13057606 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:47.167216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71827ca-d721-4577-bc5f-6cfc13057606 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:47.167908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71827ca-d721-4577-bc5f-6cfc13057606 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:47.168221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71827ca-d721-4577-bc5f-6cfc13057606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:47.169595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71827ca-d721-4577-bc5f-6cfc13057606 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:47.175135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 477/949] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:47.175534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:47.176302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:47.176588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:47.176867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:47.177572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:47.182112 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:47.182235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71827ca-d721-4577-bc5f-6cfc13057606 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:47.182335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING keystone.server.flask.common [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 30 10:33:47.233669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.sql.core [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 10:33:47.233669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 10:33:47.233669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [parameters: {'id': 'e1d075d5cfb5458db75d0a0c2cfe7a52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 10:33:47.233669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86803) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1d075d5cfb5458db75d0a0c2cfe7a52.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1d075d5cfb5458db75d0a0c2cfe7a52. Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:33:47.256917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application result.read() Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 30 10:33:47.257810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application yield resource Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise self.value Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application session.commit() Jun 30 10:33:47.258860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.session.flush() Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application compat.raise_( Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 10:33:47.259770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 10:33:47.260686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application result.read() Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:33:47.261504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [parameters: {'id': 'e1d075d5cfb5458db75d0a0c2cfe7a52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:47.262430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:47.263256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1d075d5cfb5458db75d0a0c2cfe7a52. Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:47.264222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 473/950] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Jun 30 10:33:47 2022] POST /identity/v3/projects => generated 262 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:47.264822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:47.292514 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:47.310783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71827ca-d721-4577-bc5f-6cfc13057606 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:47.344568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b4697-f10d-4b89-881a-b96d29b128ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:47.345649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b4697-f10d-4b89-881a-b96d29b128ca None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:47.346224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b4697-f10d-4b89-881a-b96d29b128ca None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:47.346791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b4697-f10d-4b89-881a-b96d29b128ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:47.348140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b4697-f10d-4b89-881a-b96d29b128ca None admin] RBAC: Adding query filter params (interface=public, service_id=7b46b21fa4404c04b47d007f93bca65d, region_id=RegionOne) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:47.348692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b4697-f10d-4b89-881a-b96d29b128ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:47.350390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b4697-f10d-4b89-881a-b96d29b128ca None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:47.360278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 478/951] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 10:33:47 2022] GET /identity/v3/endpoints?service_id=7b46b21fa4404c04b47d007f93bca65d&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:47.366083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b4697-f10d-4b89-881a-b96d29b128ca None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:47.404457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c8e1c-eb0f-4b62-8d18-ea1d99ad2255 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:47.426414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:47.448423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bd84-1500-4420-8214-c9b9539c262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:47.452213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bd84-1500-4420-8214-c9b9539c262d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:47.452213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bd84-1500-4420-8214-c9b9539c262d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:47.452213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bd84-1500-4420-8214-c9b9539c262d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:47.457612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359bd84-1500-4420-8214-c9b9539c262d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:47.459588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359bd84-1500-4420-8214-c9b9539c262d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-a359bd84-1500-4420-8214-c9b9539c262d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:47.476509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:47.478088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:47.479042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:47.479042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:47.479042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:47.479042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:47.479042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:47.479042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:47.479042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:47.479042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:47.481645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 474/952] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:47.483576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b4697-f10d-4b89-881a-b96d29b128ca None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:47.493722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bd84-1500-4420-8214-c9b9539c262d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:47.530297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7bdf0-603c-4099-becd-7a7edfe8a583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:47.531245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7bdf0-603c-4099-becd-7a7edfe8a583 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:47.531796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7bdf0-603c-4099-becd-7a7edfe8a583 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:47.532237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7bdf0-603c-4099-becd-7a7edfe8a583 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:47.533178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7bdf0-603c-4099-becd-7a7edfe8a583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:47.534788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7bdf0-603c-4099-becd-7a7edfe8a583 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:47.547542 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 479/953] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 10:33:47 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:33:47.619226 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bd84-1500-4420-8214-c9b9539c262d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:47.652478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ff1cc-9bc9-4fe6-8fae-49beda4d29c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:47.653150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ff1cc-9bc9-4fe6-8fae-49beda4d29c5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:47.653434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ff1cc-9bc9-4fe6-8fae-49beda4d29c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:47.653715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ff1cc-9bc9-4fe6-8fae-49beda4d29c5 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:47.654529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ff1cc-9bc9-4fe6-8fae-49beda4d29c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:47.654837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ff1cc-9bc9-4fe6-8fae-49beda4d29c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:47.656309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ff1cc-9bc9-4fe6-8fae-49beda4d29c5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:47.686139 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 475/954] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:47.932849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c0cd-8c6d-4b33-9f3b-d0f83eb8a3c9 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:47.933204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c0cd-8c6d-4b33-9f3b-d0f83eb8a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:47.933419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c0cd-8c6d-4b33-9f3b-d0f83eb8a3c9 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:47.935105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 480/955] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:47.940309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b41f2-0fe9-4a06-9820-8edd25018095 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:47.940608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b41f2-0fe9-4a06-9820-8edd25018095 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:47.940898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b41f2-0fe9-4a06-9820-8edd25018095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:47.958426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-585b41f2-0fe9-4a06-9820-8edd25018095 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:47.959928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-585b41f2-0fe9-4a06-9820-8edd25018095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:47.989831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:48.031831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 476/956] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:48.054991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46c0cd-8c6d-4b33-9f3b-d0f83eb8a3c9 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:48.078263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:48.164264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46c0cd-8c6d-4b33-9f3b-d0f83eb8a3c9 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:48.200718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9b6a-e3ef-4e17-83b2-6125bb3f3c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:48.201384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9b6a-e3ef-4e17-83b2-6125bb3f3c8f None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:48.201676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9b6a-e3ef-4e17-83b2-6125bb3f3c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:48.201966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9b6a-e3ef-4e17-83b2-6125bb3f3c8f None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:48.202765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9b6a-e3ef-4e17-83b2-6125bb3f3c8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:48.204258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9b6a-e3ef-4e17-83b2-6125bb3f3c8f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:48.298871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 481/957] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:33:48 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:48.306297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4dc6-4669-4321-b389-4acc57d02dc3 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:48.306636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4dc6-4669-4321-b389-4acc57d02dc3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:48.306873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4dc6-4669-4321-b389-4acc57d02dc3 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:48.308719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 477/958] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:48.315888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a1e85-64d4-4528-94ba-d5f3fdd15527 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:48.316287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a1e85-64d4-4528-94ba-d5f3fdd15527 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:48.316582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a1e85-64d4-4528-94ba-d5f3fdd15527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:48.336911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-056a1e85-64d4-4528-94ba-d5f3fdd15527 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:48.338255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-056a1e85-64d4-4528-94ba-d5f3fdd15527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:48.425184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 482/959] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:48.450191 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4dc6-4669-4321-b389-4acc57d02dc3 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:48.560436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4dc6-4669-4321-b389-4acc57d02dc3 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:48.595132 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af81a02-fa68-4de5-9c98-93686d23f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:48.595943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af81a02-fa68-4de5-9c98-93686d23f239 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:48.596230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af81a02-fa68-4de5-9c98-93686d23f239 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:48.596508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af81a02-fa68-4de5-9c98-93686d23f239 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:48.607880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af81a02-fa68-4de5-9c98-93686d23f239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-4af81a02-fa68-4de5-9c98-93686d23f239 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:48.616372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:48.624317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:48.626426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 478/960] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 10:33:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:48.628127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a1e85-64d4-4528-94ba-d5f3fdd15527 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:48.633063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:48.740905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a1e85-64d4-4528-94ba-d5f3fdd15527 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:48.777918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4503b51-d522-4b39-b593-11cd505c940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:48.778923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4503b51-d522-4b39-b593-11cd505c940c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:48.779410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4503b51-d522-4b39-b593-11cd505c940c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:48.779865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4503b51-d522-4b39-b593-11cd505c940c None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:48.780800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4503b51-d522-4b39-b593-11cd505c940c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:48.781287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4503b51-d522-4b39-b593-11cd505c940c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:48.782878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4503b51-d522-4b39-b593-11cd505c940c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:48.792556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 483/961] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 10:33:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:48.798378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af81a02-fa68-4de5-9c98-93686d23f239 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:48.827810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:48.906397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af81a02-fa68-4de5-9c98-93686d23f239 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:48.942924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04d88c-a838-4d2c-a26f-cca4dcbdb885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:48.943727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04d88c-a838-4d2c-a26f-cca4dcbdb885 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:48.944015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04d88c-a838-4d2c-a26f-cca4dcbdb885 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:48.944297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04d88c-a838-4d2c-a26f-cca4dcbdb885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:48.955315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04d88c-a838-4d2c-a26f-cca4dcbdb885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:48.956773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04d88c-a838-4d2c-a26f-cca4dcbdb885 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-7d04d88c-a838-4d2c-a26f-cca4dcbdb885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:48.974508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:48.975408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:48.976317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:48.976317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:48.976317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:48.976317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:48.976317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 479/962] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:48.983335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4503b51-d522-4b39-b593-11cd505c940c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:49.054602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:49.091335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4503b51-d522-4b39-b593-11cd505c940c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:49.127634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d8ddd-9de3-4041-9ce1-6f9a49ed8818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:49.128713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d8ddd-9de3-4041-9ce1-6f9a49ed8818 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.129208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d8ddd-9de3-4041-9ce1-6f9a49ed8818 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.129688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d8ddd-9de3-4041-9ce1-6f9a49ed8818 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.130640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d8ddd-9de3-4041-9ce1-6f9a49ed8818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:49.131182 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d8ddd-9de3-4041-9ce1-6f9a49ed8818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:49.132781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d8ddd-9de3-4041-9ce1-6f9a49ed8818 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:49.145424 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 484/963] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:49.151838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04d88c-a838-4d2c-a26f-cca4dcbdb885 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:49.233581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:49.256211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04d88c-a838-4d2c-a26f-cca4dcbdb885 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:49.292416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8478136-4176-4951-8793-37f985b58536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:49.293582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478136-4176-4951-8793-37f985b58536 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.294124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478136-4176-4951-8793-37f985b58536 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.294610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478136-4176-4951-8793-37f985b58536 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.302528 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8478136-4176-4951-8793-37f985b58536 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:49.304206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8478136-4176-4951-8793-37f985b58536 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-a8478136-4176-4951-8793-37f985b58536 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:49.319286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:49.320790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:33:49.321741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:49.324346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 480/964] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:33:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:49.330238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d8ddd-9de3-4041-9ce1-6f9a49ed8818 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:49.440662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d8ddd-9de3-4041-9ce1-6f9a49ed8818 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:49.469097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:49.477223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd212447-cf1e-48fe-a64a-a75ce147a105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:49.477903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212447-cf1e-48fe-a64a-a75ce147a105 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.478215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212447-cf1e-48fe-a64a-a75ce147a105 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.478495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212447-cf1e-48fe-a64a-a75ce147a105 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.479348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd212447-cf1e-48fe-a64a-a75ce147a105 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:49.479661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd212447-cf1e-48fe-a64a-a75ce147a105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:49.481106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd212447-cf1e-48fe-a64a-a75ce147a105 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:49.498931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 485/965] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jun 30 10:33:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:49.507570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8478136-4176-4951-8793-37f985b58536 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:49.637617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8478136-4176-4951-8793-37f985b58536 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:49.671714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a78aa-8109-48b7-a43a-4b7bf25c6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:49.674000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a78aa-8109-48b7-a43a-4b7bf25c6d3b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.674000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a78aa-8109-48b7-a43a-4b7bf25c6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.674000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a78aa-8109-48b7-a43a-4b7bf25c6d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.682750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:49.704854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4887f-8725-4b52-9600-ccf202aad1fd None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.705388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4887f-8725-4b52-9600-ccf202aad1fd None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.705468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4887f-8725-4b52-9600-ccf202aad1fd None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.707251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 486/966] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:49.712441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76277ef1-e0e7-47a4-9617-4cc519283ac3 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.712872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76277ef1-e0e7-47a4-9617-4cc519283ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.713225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76277ef1-e0e7-47a4-9617-4cc519283ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.731494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-76277ef1-e0e7-47a4-9617-4cc519283ac3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:49.732890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-76277ef1-e0e7-47a4-9617-4cc519283ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:49.749382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a78aa-8109-48b7-a43a-4b7bf25c6d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:49.751166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a78aa-8109-48b7-a43a-4b7bf25c6d3b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:49.814277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 487/967] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:49.832971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76277ef1-e0e7-47a4-9617-4cc519283ac3 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:49.872069 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 481/968] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:49 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:49.873483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4071f-5159-4255-9d1e-8d5ec71f2060 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.873776 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4071f-5159-4255-9d1e-8d5ec71f2060 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.874082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4071f-5159-4255-9d1e-8d5ec71f2060 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.875503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 482/969] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:49.878763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4071f-5159-4255-9d1e-8d5ec71f2060 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:49.926857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:49.951957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76277ef1-e0e7-47a4-9617-4cc519283ac3 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:49.970059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:49.989532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894dd1d-1078-4aca-be68-b9cec8f9505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:49.990373 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894dd1d-1078-4aca-be68-b9cec8f9505a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.990663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894dd1d-1078-4aca-be68-b9cec8f9505a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.990942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894dd1d-1078-4aca-be68-b9cec8f9505a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.991617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894dd1d-1078-4aca-be68-b9cec8f9505a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:49.993389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4071f-5159-4255-9d1e-8d5ec71f2060 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:49.993569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894dd1d-1078-4aca-be68-b9cec8f9505a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-2894dd1d-1078-4aca-be68-b9cec8f9505a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:50.006862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:50.007968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:50.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 488/970] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:50.009787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cca9d-9c8a-42a0-b4d5-7221b58e2c1b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.009787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cca9d-9c8a-42a0-b4d5-7221b58e2c1b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.009787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cca9d-9c8a-42a0-b4d5-7221b58e2c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.026209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-aa2cca9d-9c8a-42a0-b4d5-7221b58e2c1b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:50.027380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-aa2cca9d-9c8a-42a0-b4d5-7221b58e2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:50.035134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844644b3-faa9-417f-9ab7-aff81942818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.035935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844644b3-faa9-417f-9ab7-aff81942818c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.036223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844644b3-faa9-417f-9ab7-aff81942818c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.036504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844644b3-faa9-417f-9ab7-aff81942818c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.048058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844644b3-faa9-417f-9ab7-aff81942818c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.049539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844644b3-faa9-417f-9ab7-aff81942818c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-844644b3-faa9-417f-9ab7-aff81942818c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:50.067876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:50.068786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:50.069674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:50.069674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:50.069674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:50.069674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:50.069674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 483/971] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:50.069974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844644b3-faa9-417f-9ab7-aff81942818c None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.103167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 489/972] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:50.104362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cca9d-9c8a-42a0-b4d5-7221b58e2c1b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.171073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:50.181559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844644b3-faa9-417f-9ab7-aff81942818c None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.209326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cca9d-9c8a-42a0-b4d5-7221b58e2c1b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.216851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5f373-630f-4ce4-9224-783d10ac2a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.217508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5f373-630f-4ce4-9224-783d10ac2a4c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.217792 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5f373-630f-4ce4-9224-783d10ac2a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.218100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5f373-630f-4ce4-9224-783d10ac2a4c None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.218923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5f373-630f-4ce4-9224-783d10ac2a4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:50.219232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5f373-630f-4ce4-9224-783d10ac2a4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.220067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:50.221603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5f373-630f-4ce4-9224-783d10ac2a4c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.227910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 484/973] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:50.228500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5f373-630f-4ce4-9224-783d10ac2a4c None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.247307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d94ea-3141-4d41-93cb-10867ef37d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.247979 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d94ea-3141-4d41-93cb-10867ef37d64 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.248451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d94ea-3141-4d41-93cb-10867ef37d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.248560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d94ea-3141-4d41-93cb-10867ef37d64 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.249488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d94ea-3141-4d41-93cb-10867ef37d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:50.250147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d94ea-3141-4d41-93cb-10867ef37d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.251942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d94ea-3141-4d41-93cb-10867ef37d64 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.264094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 490/974] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:50.264094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d94ea-3141-4d41-93cb-10867ef37d64 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.349214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5f373-630f-4ce4-9224-783d10ac2a4c None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.371383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d94ea-3141-4d41-93cb-10867ef37d64 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.389288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.390274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.390565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.390843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.391546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.393407 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.407136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba91d0a-13dc-462d-8b35-27c46c29e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.407848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba91d0a-13dc-462d-8b35-27c46c29e7eb None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.408136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba91d0a-13dc-462d-8b35-27c46c29e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.408414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba91d0a-13dc-462d-8b35-27c46c29e7eb None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.409122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba91d0a-13dc-462d-8b35-27c46c29e7eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:50.409429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba91d0a-13dc-462d-8b35-27c46c29e7eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.410841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba91d0a-13dc-462d-8b35-27c46c29e7eb None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.416264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 491/975] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:50.423210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba91d0a-13dc-462d-8b35-27c46c29e7eb None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.442242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.sql.core [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 10:33:50.442242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 10:33:50.442242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [parameters: {'user_id': '866740079d7e4c6a84798c401d8e1ca3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 10:33:50.442242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86803) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 10:33:50.451335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application result.read() Jun 30 10:33:50.451920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:33:50.452814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application yield resource Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise self.value Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application session.commit() Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 10:33:50.453818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.session.flush() Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application compat.raise_( Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 10:33:50.460230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:33:50.462634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application result.read() Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:33:50.463710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [parameters: {'user_id': '866740079d7e4c6a84798c401d8e1ca3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:50.464753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 30 10:33:50.465750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 30 10:33:50.466951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 30 10:33:50.466951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 30 10:33:50.466951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 10:33:50.466951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 10:33:50.466951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 10:33:50.466951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:50.466951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 485/976] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jun 30 10:33:50 2022] POST /identity/v3/users => generated 160 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:50.466951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.479078 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:50.525073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba91d0a-13dc-462d-8b35-27c46c29e7eb None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.559445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296adf2f-21fb-43d9-b614-484537fc0808 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.559786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800dd85-e060-48d0-90af-a751c1701479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.560584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800dd85-e060-48d0-90af-a751c1701479 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.560872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800dd85-e060-48d0-90af-a751c1701479 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.561149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800dd85-e060-48d0-90af-a751c1701479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.567879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800dd85-e060-48d0-90af-a751c1701479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.569323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800dd85-e060-48d0-90af-a751c1701479 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1800dd85-e060-48d0-90af-a751c1701479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:50.583352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:50.584209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:50.585121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:50.585121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:50.585121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:50.585121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:50.585121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:50.585121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:50.585121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:50.585121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:50.585121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 492/977] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:50.586390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800dd85-e060-48d0-90af-a751c1701479 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.598684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf7ee7-ee23-47aa-8ff8-cd5cee9350e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.599347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf7ee7-ee23-47aa-8ff8-cd5cee9350e4 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.599636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf7ee7-ee23-47aa-8ff8-cd5cee9350e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.599921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf7ee7-ee23-47aa-8ff8-cd5cee9350e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.600666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf7ee7-ee23-47aa-8ff8-cd5cee9350e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.602881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf7ee7-ee23-47aa-8ff8-cd5cee9350e4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.678053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:50.684419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800dd85-e060-48d0-90af-a751c1701479 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.702052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 486/978] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 10:33:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:50.708516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412fb5c-8987-47ac-835d-e5b3f82c80e8 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.708516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412fb5c-8987-47ac-835d-e5b3f82c80e8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.708516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412fb5c-8987-47ac-835d-e5b3f82c80e8 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.708516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 487/979] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:50.708516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412fb5c-8987-47ac-835d-e5b3f82c80e8 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.727825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d6743-02c1-4b79-90db-615890e49785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.728652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d6743-02c1-4b79-90db-615890e49785 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.728940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d6743-02c1-4b79-90db-615890e49785 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.729212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d6743-02c1-4b79-90db-615890e49785 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.737593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d6743-02c1-4b79-90db-615890e49785 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.739164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d6743-02c1-4b79-90db-615890e49785 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-ba4d6743-02c1-4b79-90db-615890e49785 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:50.755029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:50.756104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:33:50.757068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:50.762688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 493/980] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:50.764530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169d75-0caa-42df-9f17-16049c406ad6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.764823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169d75-0caa-42df-9f17-16049c406ad6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.765100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169d75-0caa-42df-9f17-16049c406ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.782954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b9169d75-0caa-42df-9f17-16049c406ad6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:50.784178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b9169d75-0caa-42df-9f17-16049c406ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:50.809303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:50.845264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412fb5c-8987-47ac-835d-e5b3f82c80e8 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.864980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 494/981] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:50.866145 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169d75-0caa-42df-9f17-16049c406ad6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.881840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf238b-5688-46aa-a712-c5607d2f7158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.882555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf238b-5688-46aa-a712-c5607d2f7158 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.883388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf238b-5688-46aa-a712-c5607d2f7158 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.883665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf238b-5688-46aa-a712-c5607d2f7158 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.884451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf238b-5688-46aa-a712-c5607d2f7158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:50.884768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf238b-5688-46aa-a712-c5607d2f7158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.886313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf238b-5688-46aa-a712-c5607d2f7158 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.901288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 488/982] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:50.902275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf238b-5688-46aa-a712-c5607d2f7158 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.966134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:50.988417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169d75-0caa-42df-9f17-16049c406ad6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:51.018509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf238b-5688-46aa-a712-c5607d2f7158 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:51.024861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a1a2f-f369-4d38-9595-cf4ab6368ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:51.025654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a1a2f-f369-4d38-9595-cf4ab6368ecf None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.025964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a1a2f-f369-4d38-9595-cf4ab6368ecf None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.026258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a1a2f-f369-4d38-9595-cf4ab6368ecf None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.027076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a1a2f-f369-4d38-9595-cf4ab6368ecf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:51.027394 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a1a2f-f369-4d38-9595-cf4ab6368ecf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:51.028844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a1a2f-f369-4d38-9595-cf4ab6368ecf None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:51.050355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:51.056508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68509a-8bb8-4ed7-82c9-0dc8df9c21f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:51.057312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68509a-8bb8-4ed7-82c9-0dc8df9c21f1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.057638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68509a-8bb8-4ed7-82c9-0dc8df9c21f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.057881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68509a-8bb8-4ed7-82c9-0dc8df9c21f1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.058625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68509a-8bb8-4ed7-82c9-0dc8df9c21f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:51.059994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68509a-8bb8-4ed7-82c9-0dc8df9c21f1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:51.064473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 495/983] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:51.074441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a1a2f-f369-4d38-9595-cf4ab6368ecf None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-7f68509a-8bb8-4ed7-82c9-0dc8df9c21f1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:51.074545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:51.075570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:51.076435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 489/984] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:51.095391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68509a-8bb8-4ed7-82c9-0dc8df9c21f1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:51.211110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a1a2f-f369-4d38-9595-cf4ab6368ecf None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:51.223260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68509a-8bb8-4ed7-82c9-0dc8df9c21f1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:51.268764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2b838-eaa9-46c6-812c-5687f929da29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:51.269432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2b838-eaa9-46c6-812c-5687f929da29 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.269721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2b838-eaa9-46c6-812c-5687f929da29 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.270034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2b838-eaa9-46c6-812c-5687f929da29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.270628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20902b25-30f0-4eb5-bb38-ce93c476f2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:51.270884 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2b838-eaa9-46c6-812c-5687f929da29 None admin] RBAC: Adding query filter params (role.id=f8e83f8093fd4211ba9af2015d7f0fa1, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=25df9d4438a34863bbde92da4be8c0df) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:51.271203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2b838-eaa9-46c6-812c-5687f929da29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:51.271490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20902b25-30f0-4eb5-bb38-ce93c476f2f6 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.271847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20902b25-30f0-4eb5-bb38-ce93c476f2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.272195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20902b25-30f0-4eb5-bb38-ce93c476f2f6 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.272643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2b838-eaa9-46c6-812c-5687f929da29 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:51.273049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20902b25-30f0-4eb5-bb38-ce93c476f2f6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:51.273460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20902b25-30f0-4eb5-bb38-ce93c476f2f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:51.274904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20902b25-30f0-4eb5-bb38-ce93c476f2f6 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:51.280006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 496/985] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:51 2022] GET /identity/v3/role_assignments?user.id=25df9d4438a34863bbde92da4be8c0df&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=f8e83f8093fd4211ba9af2015d7f0fa1 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:51.280262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 490/986] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:51.289980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2b838-eaa9-46c6-812c-5687f929da29 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:51.289980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:51.407438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2b838-eaa9-46c6-812c-5687f929da29 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:51.447154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29105499-9691-49cf-ad32-f92a1ec9be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:51.447826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29105499-9691-49cf-ad32-f92a1ec9be2b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.448112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29105499-9691-49cf-ad32-f92a1ec9be2b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.448396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29105499-9691-49cf-ad32-f92a1ec9be2b None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.449106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29105499-9691-49cf-ad32-f92a1ec9be2b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:51.449417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29105499-9691-49cf-ad32-f92a1ec9be2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:51.450833 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29105499-9691-49cf-ad32-f92a1ec9be2b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:51.456473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 497/987] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:51.462147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20902b25-30f0-4eb5-bb38-ce93c476f2f6 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:51.526710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:51.567811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20902b25-30f0-4eb5-bb38-ce93c476f2f6 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:51.602264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da25d4-7e13-44cc-87c6-bffaae03242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:51.602927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da25d4-7e13-44cc-87c6-bffaae03242f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.603222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da25d4-7e13-44cc-87c6-bffaae03242f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.603631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da25d4-7e13-44cc-87c6-bffaae03242f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.604298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da25d4-7e13-44cc-87c6-bffaae03242f None admin] RBAC: Adding query filter params (interface=public, service_id=06af682026b44449ba3cb849fb27624a, region_id=RegionOne) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:51.604617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da25d4-7e13-44cc-87c6-bffaae03242f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:51.606120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da25d4-7e13-44cc-87c6-bffaae03242f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:51.611398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 491/988] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 10:33:51 2022] GET /identity/v3/endpoints?service_id=06af682026b44449ba3cb849fb27624a&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:51.617618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29105499-9691-49cf-ad32-f92a1ec9be2b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:51.685924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:51.720992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29105499-9691-49cf-ad32-f92a1ec9be2b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:51.756321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf599-dbe1-47d5-9520-0fcd8d7a7f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:51.757091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf599-dbe1-47d5-9520-0fcd8d7a7f60 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.757326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf599-dbe1-47d5-9520-0fcd8d7a7f60 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.757668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf599-dbe1-47d5-9520-0fcd8d7a7f60 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.758395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf599-dbe1-47d5-9520-0fcd8d7a7f60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:51.759776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf599-dbe1-47d5-9520-0fcd8d7a7f60 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:51.770026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 498/989] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 10:33:51 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:33:52.781590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d56c0-5116-4a7f-8309-5b93e9f331a9 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:52.782139 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d56c0-5116-4a7f-8309-5b93e9f331a9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:52.782663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d56c0-5116-4a7f-8309-5b93e9f331a9 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:52.785237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 492/990] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:52.790899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec78d2d-43e9-4d12-97b2-12c7831e9ae0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:52.791350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec78d2d-43e9-4d12-97b2-12c7831e9ae0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:52.791525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec78d2d-43e9-4d12-97b2-12c7831e9ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:52.808876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-bec78d2d-43e9-4d12-97b2-12c7831e9ae0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:52.810090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bec78d2d-43e9-4d12-97b2-12c7831e9ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:52.901988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 499/991] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:52.923602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d56c0-5116-4a7f-8309-5b93e9f331a9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.034533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d56c0-5116-4a7f-8309-5b93e9f331a9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:53.058500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:53.069346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21d5c-82b9-47ca-aa83-0042f59891da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:53.070210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21d5c-82b9-47ca-aa83-0042f59891da None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.070501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21d5c-82b9-47ca-aa83-0042f59891da None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.070893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21d5c-82b9-47ca-aa83-0042f59891da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.071502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd21d5c-82b9-47ca-aa83-0042f59891da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:53.072867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd21d5c-82b9-47ca-aa83-0042f59891da None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-afd21d5c-82b9-47ca-aa83-0042f59891da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:53.084851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:53.085832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:53.086980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:53.090269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 493/992] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:53.092145 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec78d2d-43e9-4d12-97b2-12c7831e9ae0 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.152135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:53.193895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec78d2d-43e9-4d12-97b2-12c7831e9ae0 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:53.230062 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b0ca6-9e7f-4f99-83ba-9c4bee15fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:53.230737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0ca6-9e7f-4f99-83ba-9c4bee15fcae None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.231026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0ca6-9e7f-4f99-83ba-9c4bee15fcae None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.231309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0ca6-9e7f-4f99-83ba-9c4bee15fcae None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.232031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b0ca6-9e7f-4f99-83ba-9c4bee15fcae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:53.232346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b0ca6-9e7f-4f99-83ba-9c4bee15fcae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:53.233734 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b0ca6-9e7f-4f99-83ba-9c4bee15fcae None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:53.243716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 500/993] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:53.245289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21d5c-82b9-47ca-aa83-0042f59891da None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.345342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21d5c-82b9-47ca-aa83-0042f59891da None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:53.359878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531f155-6436-4eda-b2c1-40d4c0aa6196 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.360261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531f155-6436-4eda-b2c1-40d4c0aa6196 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.360649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531f155-6436-4eda-b2c1-40d4c0aa6196 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.362260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 501/994] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:33:53.367530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c61b1-d168-46f8-bce1-42439756e96f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.367828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c61b1-d168-46f8-bce1-42439756e96f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.368112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c61b1-d168-46f8-bce1-42439756e96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.381582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd60390-6a10-45fb-813e-a520ccca6e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:53.383982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd60390-6a10-45fb-813e-a520ccca6e27 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.384276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd60390-6a10-45fb-813e-a520ccca6e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.384557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd60390-6a10-45fb-813e-a520ccca6e27 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.384852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d32c61b1-d168-46f8-bce1-42439756e96f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:53.385284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd60390-6a10-45fb-813e-a520ccca6e27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:53.385600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd60390-6a10-45fb-813e-a520ccca6e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:53.386064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d32c61b1-d168-46f8-bce1-42439756e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:53.387000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd60390-6a10-45fb-813e-a520ccca6e27 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:53.392929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 494/995] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:53.399177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd60390-6a10-45fb-813e-a520ccca6e27 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.456693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 502/996] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:53.467084 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:53.480283 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c61b1-d168-46f8-bce1-42439756e96f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.508793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd60390-6a10-45fb-813e-a520ccca6e27 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:53.536790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:53.545728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407ec61-248c-4a1d-ab25-f06975b053dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:53.552394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407ec61-248c-4a1d-ab25-f06975b053dc None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.552394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407ec61-248c-4a1d-ab25-f06975b053dc None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.552394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407ec61-248c-4a1d-ab25-f06975b053dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.552394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407ec61-248c-4a1d-ab25-f06975b053dc None admin] RBAC: Adding query filter params (interface=admin, service_id=7b46b21fa4404c04b47d007f93bca65d, region_id=RegionOne) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:53.552394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407ec61-248c-4a1d-ab25-f06975b053dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:53.552394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407ec61-248c-4a1d-ab25-f06975b053dc None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:53.556248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 495/997] 10.222.0.26 () {56 vars in 1249 bytes} [Thu Jun 30 10:33:53 2022] GET /identity/v3/endpoints?service_id=7b46b21fa4404c04b47d007f93bca65d&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:53.561670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407ec61-248c-4a1d-ab25-f06975b053dc None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.587039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c61b1-d168-46f8-bce1-42439756e96f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:53.625745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143b9a2-531a-41db-8969-eeee0ee2f8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:53.626493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143b9a2-531a-41db-8969-eeee0ee2f8ad None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.626784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143b9a2-531a-41db-8969-eeee0ee2f8ad None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.627063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143b9a2-531a-41db-8969-eeee0ee2f8ad None admin] PATH_INFO: `/v3/services/image` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.627721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143b9a2-531a-41db-8969-eeee0ee2f8ad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:53.629103 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143b9a2-531a-41db-8969-eeee0ee2f8ad None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-a143b9a2-531a-41db-8969-eeee0ee2f8ad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:53.641184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:53.642280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:33:53.643163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:53.645121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 503/998] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jun 30 10:33:53 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:53.649880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143b9a2-531a-41db-8969-eeee0ee2f8ad None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.674370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407ec61-248c-4a1d-ab25-f06975b053dc None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:53.691732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:53.711625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a337-4bf3-4dc4-a947-e4c6a7f9458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:53.712735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a337-4bf3-4dc4-a947-e4c6a7f9458f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.713195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a337-4bf3-4dc4-a947-e4c6a7f9458f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.713491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a337-4bf3-4dc4-a947-e4c6a7f9458f None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.714210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271a337-4bf3-4dc4-a947-e4c6a7f9458f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:53.715579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271a337-4bf3-4dc4-a947-e4c6a7f9458f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:53.721894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 496/999] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 10:33:53 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:33:53.758918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143b9a2-531a-41db-8969-eeee0ee2f8ad None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:53.778300 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:53.795508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b92053-96e7-441a-845d-e10506950d2d None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.796037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b92053-96e7-441a-845d-e10506950d2d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.796037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b92053-96e7-441a-845d-e10506950d2d None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.797002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1752c-a860-4f0e-8773-ffc5f1bf292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:53.797692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 497/1000] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:33:53.797797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1752c-a860-4f0e-8773-ffc5f1bf292b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.798077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1752c-a860-4f0e-8773-ffc5f1bf292b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.798365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1752c-a860-4f0e-8773-ffc5f1bf292b None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.799163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1752c-a860-4f0e-8773-ffc5f1bf292b None admin] RBAC: Adding query filter params (name=image) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:53.799486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1752c-a860-4f0e-8773-ffc5f1bf292b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:53.800970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1752c-a860-4f0e-8773-ffc5f1bf292b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:53.803067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f34589-e1c0-4d9b-acc4-d1824f440be4 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.803361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f34589-e1c0-4d9b-acc4-d1824f440be4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.803640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f34589-e1c0-4d9b-acc4-d1824f440be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.812411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 504/1001] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:53.813194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1752c-a860-4f0e-8773-ffc5f1bf292b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.822558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b9f34589-e1c0-4d9b-acc4-d1824f440be4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:53.824128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b9f34589-e1c0-4d9b-acc4-d1824f440be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:53.907770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 498/1002] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:53.928894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1752c-a860-4f0e-8773-ffc5f1bf292b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:53.932702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f34589-e1c0-4d9b-acc4-d1824f440be4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.967897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f48cf-7b49-4474-99fb-9d0577170083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:53.968560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f48cf-7b49-4474-99fb-9d0577170083 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.968848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f48cf-7b49-4474-99fb-9d0577170083 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.969123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f48cf-7b49-4474-99fb-9d0577170083 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.969830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f48cf-7b49-4474-99fb-9d0577170083 None admin] RBAC: Adding query filter params (type=image) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:53.970170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f48cf-7b49-4474-99fb-9d0577170083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:53.971540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f48cf-7b49-4474-99fb-9d0577170083 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:53.977356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 505/1003] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:54.047115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f34589-e1c0-4d9b-acc4-d1824f440be4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:54.060908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:54.085261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a4a70-4ce0-4e3e-ad45-1602b45d00b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:54.086141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a4a70-4ce0-4e3e-ad45-1602b45d00b6 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:54.086426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a4a70-4ce0-4e3e-ad45-1602b45d00b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:54.086705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a4a70-4ce0-4e3e-ad45-1602b45d00b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:54.087380 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a4a70-4ce0-4e3e-ad45-1602b45d00b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:54.088852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a4a70-4ce0-4e3e-ad45-1602b45d00b6 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-3d9a4a70-4ce0-4e3e-ad45-1602b45d00b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:54.102906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:54.103989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:33:54.104838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:54.106542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 499/1004] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:54.110238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f48cf-7b49-4474-99fb-9d0577170083 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:54.165309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:54.219289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f48cf-7b49-4474-99fb-9d0577170083 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:54.254659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edcb96-f8be-44a9-827d-caa2e4e26936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:54.255721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edcb96-f8be-44a9-827d-caa2e4e26936 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:54.256209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edcb96-f8be-44a9-827d-caa2e4e26936 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:54.256728 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edcb96-f8be-44a9-827d-caa2e4e26936 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:54.257701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edcb96-f8be-44a9-827d-caa2e4e26936 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:54.258250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edcb96-f8be-44a9-827d-caa2e4e26936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:54.259916 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edcb96-f8be-44a9-827d-caa2e4e26936 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:54.269985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 506/1005] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:54.271099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a4a70-4ce0-4e3e-ad45-1602b45d00b6 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:54.374689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a4a70-4ce0-4e3e-ad45-1602b45d00b6 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:54.408699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538ff5f-81f3-4188-a9b6-7a92c7dd0ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:54.409367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538ff5f-81f3-4188-a9b6-7a92c7dd0ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:54.409658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538ff5f-81f3-4188-a9b6-7a92c7dd0ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:54.409949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538ff5f-81f3-4188-a9b6-7a92c7dd0ca5 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:54.410676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538ff5f-81f3-4188-a9b6-7a92c7dd0ca5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:54.410989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538ff5f-81f3-4188-a9b6-7a92c7dd0ca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:54.412355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538ff5f-81f3-4188-a9b6-7a92c7dd0ca5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:54.422880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 500/1006] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jun 30 10:33:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:54.424229 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edcb96-f8be-44a9-827d-caa2e4e26936 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:54.528760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edcb96-f8be-44a9-827d-caa2e4e26936 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:54.539464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:54.562113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b9c38-7ee4-4531-98aa-eebb7852aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:54.562867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b9c38-7ee4-4531-98aa-eebb7852aff4 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:54.563059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b9c38-7ee4-4531-98aa-eebb7852aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:54.563332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b9c38-7ee4-4531-98aa-eebb7852aff4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:54.564066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b9c38-7ee4-4531-98aa-eebb7852aff4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:54.565440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b9c38-7ee4-4531-98aa-eebb7852aff4 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:54.674050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 507/1007] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 10:33:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:33:55.775291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa95b04-7505-4857-90c1-b92709cfbaf9 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:55.775867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa95b04-7505-4857-90c1-b92709cfbaf9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:55.775867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa95b04-7505-4857-90c1-b92709cfbaf9 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:55.777354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 501/1008] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:55.782321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac93b5-944c-403f-b7e1-8b49e8074462 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:55.782700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac93b5-944c-403f-b7e1-8b49e8074462 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:55.782891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac93b5-944c-403f-b7e1-8b49e8074462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:55.800135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-cfac93b5-944c-403f-b7e1-8b49e8074462 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:55.801309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cfac93b5-944c-403f-b7e1-8b49e8074462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:55.877791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 508/1009] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:55 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:55.901389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa95b04-7505-4857-90c1-b92709cfbaf9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:55.943802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:56.004702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa95b04-7505-4857-90c1-b92709cfbaf9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:56.015488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02f0c1-377f-4ff9-b8fe-03eb36846de5 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.015781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02f0c1-377f-4ff9-b8fe-03eb36846de5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.016068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02f0c1-377f-4ff9-b8fe-03eb36846de5 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.017555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 509/1010] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:33:56.022406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc1e1-84ba-4a5c-acd8-b79a33479070 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.022773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc1e1-84ba-4a5c-acd8-b79a33479070 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.023686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc1e1-84ba-4a5c-acd8-b79a33479070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.040901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-aabbc1e1-84ba-4a5c-acd8-b79a33479070 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:56.042099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-aabbc1e1-84ba-4a5c-acd8-b79a33479070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:56.043822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006f7e3-7606-415a-b253-da71d59e9b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:56.044633 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006f7e3-7606-415a-b253-da71d59e9b54 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.044927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006f7e3-7606-415a-b253-da71d59e9b54 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.045207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006f7e3-7606-415a-b253-da71d59e9b54 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.045869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006f7e3-7606-415a-b253-da71d59e9b54 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:56.047271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006f7e3-7606-415a-b253-da71d59e9b54 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-f006f7e3-7606-415a-b253-da71d59e9b54 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:56.059306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:56.062121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:56.062987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 502/1011] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jun 30 10:33:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:56.066530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006f7e3-7606-415a-b253-da71d59e9b54 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:56.122247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 510/1012] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:56 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:56.138900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc1e1-84ba-4a5c-acd8-b79a33479070 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:56.164502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:56.168575 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006f7e3-7606-415a-b253-da71d59e9b54 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:56.170232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:56.205376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf0867-ea8a-48e6-99c8-f56cadf40163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:56.206242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0867-ea8a-48e6-99c8-f56cadf40163 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.206533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0867-ea8a-48e6-99c8-f56cadf40163 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.206878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0867-ea8a-48e6-99c8-f56cadf40163 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.207605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf0867-ea8a-48e6-99c8-f56cadf40163 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:56.208152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf0867-ea8a-48e6-99c8-f56cadf40163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:56.209538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf0867-ea8a-48e6-99c8-f56cadf40163 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:56.215297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 503/1013] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:56.220911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf0867-ea8a-48e6-99c8-f56cadf40163 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:56.251409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc1e1-84ba-4a5c-acd8-b79a33479070 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:56.296114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19ecd4-e653-4a76-b884-89410939243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:56.296876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19ecd4-e653-4a76-b884-89410939243e None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.297167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19ecd4-e653-4a76-b884-89410939243e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.298112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19ecd4-e653-4a76-b884-89410939243e None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.298891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19ecd4-e653-4a76-b884-89410939243e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:56.300277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19ecd4-e653-4a76-b884-89410939243e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:56.327580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf0867-ea8a-48e6-99c8-f56cadf40163 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:56.361120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deec4d-07b4-4a53-bf98-845905a9c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:56.361789 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deec4d-07b4-4a53-bf98-845905a9c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.362113 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deec4d-07b4-4a53-bf98-845905a9c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.362400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deec4d-07b4-4a53-bf98-845905a9c4a7 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.363157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deec4d-07b4-4a53-bf98-845905a9c4a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:56.363472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deec4d-07b4-4a53-bf98-845905a9c4a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:56.364842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deec4d-07b4-4a53-bf98-845905a9c4a7 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:56.370239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 504/1014] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jun 30 10:33:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:56.375820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deec4d-07b4-4a53-bf98-845905a9c4a7 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:56.393970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 511/1015] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:33:56 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:33:56.410738 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:56.488558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deec4d-07b4-4a53-bf98-845905a9c4a7 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:56.531808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d272b-178c-4532-aa55-8f0950dcca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:56.532489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d272b-178c-4532-aa55-8f0950dcca07 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.532779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d272b-178c-4532-aa55-8f0950dcca07 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.533059 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d272b-178c-4532-aa55-8f0950dcca07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.533818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d272b-178c-4532-aa55-8f0950dcca07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:56.535233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d272b-178c-4532-aa55-8f0950dcca07 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:56.618008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 505/1016] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 10:33:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:33:56.795230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378acb7e-4133-449e-aeeb-d309246c5730 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.795740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378acb7e-4133-449e-aeeb-d309246c5730 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.795847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378acb7e-4133-449e-aeeb-d309246c5730 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.797264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 512/1017] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:56.802462 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6785e3-8214-4967-8190-48b9385fdc52 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.802887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6785e3-8214-4967-8190-48b9385fdc52 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.803165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6785e3-8214-4967-8190-48b9385fdc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.821215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2a6785e3-8214-4967-8190-48b9385fdc52 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:56.822409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2a6785e3-8214-4967-8190-48b9385fdc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:56.905015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 506/1018] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:56.930041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378acb7e-4133-449e-aeeb-d309246c5730 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:57.024632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:57.044128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378acb7e-4133-449e-aeeb-d309246c5730 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:57.078838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15646-10fb-4c28-ac96-914db5bf3069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:57.079652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15646-10fb-4c28-ac96-914db5bf3069 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:57.079943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15646-10fb-4c28-ac96-914db5bf3069 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:57.080220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15646-10fb-4c28-ac96-914db5bf3069 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:57.090657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e15646-10fb-4c28-ac96-914db5bf3069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-07e15646-10fb-4c28-ac96-914db5bf3069 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:33:57.099351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:57.100318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:33:57.101690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:57.106225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 513/1019] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 10:33:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:57.107440 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6785e3-8214-4967-8190-48b9385fdc52 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:57.123234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:57.210104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6785e3-8214-4967-8190-48b9385fdc52 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:57.244625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6f17-8238-4405-8c13-5ce7aa7a51fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:57.245292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6f17-8238-4405-8c13-5ce7aa7a51fc None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:57.245583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6f17-8238-4405-8c13-5ce7aa7a51fc None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:57.245861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6f17-8238-4405-8c13-5ce7aa7a51fc None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:57.246642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b6f17-8238-4405-8c13-5ce7aa7a51fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:57.246956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b6f17-8238-4405-8c13-5ce7aa7a51fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:57.248322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b6f17-8238-4405-8c13-5ce7aa7a51fc None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:57.256732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 507/1020] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 10:33:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:57.262243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15646-10fb-4c28-ac96-914db5bf3069 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:57.365222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15646-10fb-4c28-ac96-914db5bf3069 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:57.399451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19768506-d9c8-4e7a-8d76-d09674614eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:57.400242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19768506-d9c8-4e7a-8d76-d09674614eb3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:57.400527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19768506-d9c8-4e7a-8d76-d09674614eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:57.400805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19768506-d9c8-4e7a-8d76-d09674614eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:57.411349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19768506-d9c8-4e7a-8d76-d09674614eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:57.412791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19768506-d9c8-4e7a-8d76-d09674614eb3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:57.415583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-19768506-d9c8-4e7a-8d76-d09674614eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:57.432291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:57.433197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:57.439155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:57.439155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:57.439155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:57.439155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:57.439155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 514/1021] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:57.439447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6f17-8238-4405-8c13-5ce7aa7a51fc None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:57.517202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:57.542392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6f17-8238-4405-8c13-5ce7aa7a51fc None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:57.576029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be3e6f-5379-4f73-b513-2c119da76ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:57.576689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be3e6f-5379-4f73-b513-2c119da76ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:57.576971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be3e6f-5379-4f73-b513-2c119da76ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:57.577247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be3e6f-5379-4f73-b513-2c119da76ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:57.577985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be3e6f-5379-4f73-b513-2c119da76ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:57.578298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be3e6f-5379-4f73-b513-2c119da76ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:57.579687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be3e6f-5379-4f73-b513-2c119da76ce1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:57.592300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 508/1022] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:57.597928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19768506-d9c8-4e7a-8d76-d09674614eb3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:57.701641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19768506-d9c8-4e7a-8d76-d09674614eb3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:57.735719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a8a9d-3079-40d4-9904-99e6510f9726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:57.736537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a8a9d-3079-40d4-9904-99e6510f9726 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:57.736826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a8a9d-3079-40d4-9904-99e6510f9726 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:57.737106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a8a9d-3079-40d4-9904-99e6510f9726 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:57.747186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a8a9d-3079-40d4-9904-99e6510f9726 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:57.748664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a8a9d-3079-40d4-9904-99e6510f9726 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-4b4a8a9d-3079-40d4-9904-99e6510f9726 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:33:57.763236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:57.764153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:57.765104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 515/1023] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 10:33:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:57.771759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be3e6f-5379-4f73-b513-2c119da76ce1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:57.870102 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be3e6f-5379-4f73-b513-2c119da76ce1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:57.916716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c619fd3-19dc-4aae-94c1-ff21a52f7536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:57.917418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c619fd3-19dc-4aae-94c1-ff21a52f7536 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:57.917811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c619fd3-19dc-4aae-94c1-ff21a52f7536 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:57.918141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c619fd3-19dc-4aae-94c1-ff21a52f7536 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:57.919186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c619fd3-19dc-4aae-94c1-ff21a52f7536 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:57.919501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c619fd3-19dc-4aae-94c1-ff21a52f7536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:57.920922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c619fd3-19dc-4aae-94c1-ff21a52f7536 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:57.922912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:57.941797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 509/1024] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 10:33:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:57.948178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a8a9d-3079-40d4-9904-99e6510f9726 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:58.014289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:58.068995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a8a9d-3079-40d4-9904-99e6510f9726 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:58.105322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d9cd1-def3-4fd0-9367-f0e338a67f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:58.106008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d9cd1-def3-4fd0-9367-f0e338a67f3c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.106298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d9cd1-def3-4fd0-9367-f0e338a67f3c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.106576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d9cd1-def3-4fd0-9367-f0e338a67f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.174410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d9cd1-def3-4fd0-9367-f0e338a67f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:58.175862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d9cd1-def3-4fd0-9367-f0e338a67f3c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:58.230568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:58.281382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 516/1025] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:33:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:33:58.282594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c619fd3-19dc-4aae-94c1-ff21a52f7536 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:58.382927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c619fd3-19dc-4aae-94c1-ff21a52f7536 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:58.417105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f99f28-3fa8-47c5-91f1-c872efdb1254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:58.417901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f99f28-3fa8-47c5-91f1-c872efdb1254 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.418216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f99f28-3fa8-47c5-91f1-c872efdb1254 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.418497 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f99f28-3fa8-47c5-91f1-c872efdb1254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f99f28-3fa8-47c5-91f1-c872efdb1254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f99f28-3fa8-47c5-91f1-c872efdb1254 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-a0f99f28-3fa8-47c5-91f1-c872efdb1254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:58.457759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:58.459463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:58.460420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 510/1026] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:58.462279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d9cd1-def3-4fd0-9367-f0e338a67f3c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:58.486011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035bf52-a7a1-4a09-a6b7-b228eeb5f4f2 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.486555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035bf52-a7a1-4a09-a6b7-b228eeb5f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.486983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035bf52-a7a1-4a09-a6b7-b228eeb5f4f2 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.488688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 511/1027] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:58.494794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c5722-2302-4b2d-9e13-055cbfbaf0e7 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.495083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c5722-2302-4b2d-9e13-055cbfbaf0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.495360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c5722-2302-4b2d-9e13-055cbfbaf0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.513767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b84c5722-2302-4b2d-9e13-055cbfbaf0e7 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:58.514977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b84c5722-2302-4b2d-9e13-055cbfbaf0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:58.562388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:58.585523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d9cd1-def3-4fd0-9367-f0e338a67f3c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:58.589579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 512/1028] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:33:58.613108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c5722-2302-4b2d-9e13-055cbfbaf0e7 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:58.623062 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6c135-1c89-4510-8caf-be11ad3abdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:58.626865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c135-1c89-4510-8caf-be11ad3abdca None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.626865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c135-1c89-4510-8caf-be11ad3abdca None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.626865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c135-1c89-4510-8caf-be11ad3abdca None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.626865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6c135-1c89-4510-8caf-be11ad3abdca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:58.626865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6c135-1c89-4510-8caf-be11ad3abdca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:58.626865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6c135-1c89-4510-8caf-be11ad3abdca None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:58.639192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 517/1029] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:58.644553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6c135-1c89-4510-8caf-be11ad3abdca None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:58.662392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:58.715599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c5722-2302-4b2d-9e13-055cbfbaf0e7 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:58.749267 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e9e89-b578-40fd-9c76-90e17d00b246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:58.750083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9e89-b578-40fd-9c76-90e17d00b246 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.750376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9e89-b578-40fd-9c76-90e17d00b246 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.750470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6c135-1c89-4510-8caf-be11ad3abdca None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:58.750661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9e89-b578-40fd-9c76-90e17d00b246 None admin] PATH_INFO: `/v3/services/image` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.751319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e9e89-b578-40fd-9c76-90e17d00b246 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:58.752699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e9e89-b578-40fd-9c76-90e17d00b246 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-668e9e89-b578-40fd-9c76-90e17d00b246 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:58.764259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:58.765242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:33:58.766104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 513/1030] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jun 30 10:33:58 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:33:58.766912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0737-385e-499d-935a-6e3284bfa6cd None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.766912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0737-385e-499d-935a-6e3284bfa6cd None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.767240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0737-385e-499d-935a-6e3284bfa6cd None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.769977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 514/1031] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:58.771239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0737-385e-499d-935a-6e3284bfa6cd None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:58.785716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7934a-6d26-4890-8d1f-a16025710bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:58.786536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7934a-6d26-4890-8d1f-a16025710bd1 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.786821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7934a-6d26-4890-8d1f-a16025710bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.787100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7934a-6d26-4890-8d1f-a16025710bd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.794451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7934a-6d26-4890-8d1f-a16025710bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:58.795889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7934a-6d26-4890-8d1f-a16025710bd1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-bfe7934a-6d26-4890-8d1f-a16025710bd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:33:58.809736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:33:58.810676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:33:58.811560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:33:58.811560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:33:58.811560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:33:58.811560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:33:58.811560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:33:58.811560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:33:58.811560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:33:58.811560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:33:58.811560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 518/1032] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:33:58.812153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9b35-e428-4ee3-afeb-d89eaf32a7d6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.812403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9b35-e428-4ee3-afeb-d89eaf32a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.812684 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9b35-e428-4ee3-afeb-d89eaf32a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.816223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:58.829161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-33cb9b35-e428-4ee3-afeb-d89eaf32a7d6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:58.830364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-33cb9b35-e428-4ee3-afeb-d89eaf32a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:58.874150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0737-385e-499d-935a-6e3284bfa6cd None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:58.905136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 519/1033] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:33:58.906008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9b35-e428-4ee3-afeb-d89eaf32a7d6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:58.909477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:58.923746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d0ea3-4b70-4063-a823-676ed933e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:58.928343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d0ea3-4b70-4063-a823-676ed933e435 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.928343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d0ea3-4b70-4063-a823-676ed933e435 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.928343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d0ea3-4b70-4063-a823-676ed933e435 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.928343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d0ea3-4b70-4063-a823-676ed933e435 None admin] RBAC: Adding query filter params (name=image) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:58.928343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d0ea3-4b70-4063-a823-676ed933e435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:58.928343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d0ea3-4b70-4063-a823-676ed933e435 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:58.937856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 515/1034] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:33:58.937856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d0ea3-4b70-4063-a823-676ed933e435 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:59.005002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9b35-e428-4ee3-afeb-d89eaf32a7d6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:59.037461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d0ea3-4b70-4063-a823-676ed933e435 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:59.039051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:59.039708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0acef-4293-4ed5-bc98-e381b1245eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:59.040105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0acef-4293-4ed5-bc98-e381b1245eb1 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.040396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0acef-4293-4ed5-bc98-e381b1245eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.040680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0acef-4293-4ed5-bc98-e381b1245eb1 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.041475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0acef-4293-4ed5-bc98-e381b1245eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:59.041790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0acef-4293-4ed5-bc98-e381b1245eb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:59.043261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0acef-4293-4ed5-bc98-e381b1245eb1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:59.055236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 520/1035] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:59.056032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0acef-4293-4ed5-bc98-e381b1245eb1 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:59.071600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e87fc-ffed-4ad7-8a05-e0f29e4e84ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:59.072962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e87fc-ffed-4ad7-8a05-e0f29e4e84ac None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.073451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e87fc-ffed-4ad7-8a05-e0f29e4e84ac None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.074055 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e87fc-ffed-4ad7-8a05-e0f29e4e84ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.075253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e87fc-ffed-4ad7-8a05-e0f29e4e84ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:59.076693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e87fc-ffed-4ad7-8a05-e0f29e4e84ac None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:59.078347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 516/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:59.079106 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e87fc-ffed-4ad7-8a05-e0f29e4e84ac None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:59.126132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:59.167082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0acef-4293-4ed5-bc98-e381b1245eb1 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:59.176391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e87fc-ffed-4ad7-8a05-e0f29e4e84ac None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:59.200863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db5bd-f7a7-462e-bc29-1eec7150dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:59.201532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db5bd-f7a7-462e-bc29-1eec7150dd68 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.201822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db5bd-f7a7-462e-bc29-1eec7150dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.202141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db5bd-f7a7-462e-bc29-1eec7150dd68 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.202849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680db5bd-f7a7-462e-bc29-1eec7150dd68 None admin] RBAC: Adding query filter params (type=image) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:59.203164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680db5bd-f7a7-462e-bc29-1eec7150dd68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:59.204541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680db5bd-f7a7-462e-bc29-1eec7150dd68 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:59.209311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 521/1037] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:33:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:59.209524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297541d5-5a61-4727-98fc-0da35fadf25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:59.210099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db5bd-f7a7-462e-bc29-1eec7150dd68 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:59.210234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297541d5-5a61-4727-98fc-0da35fadf25e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.210234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297541d5-5a61-4727-98fc-0da35fadf25e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.211248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297541d5-5a61-4727-98fc-0da35fadf25e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.212090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297541d5-5a61-4727-98fc-0da35fadf25e None admin] RBAC: Adding query filter params (role.id=f8e83f8093fd4211ba9af2015d7f0fa1, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=0f46cf6eb4a44a71bda92cb212a8009c) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:59.212408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297541d5-5a61-4727-98fc-0da35fadf25e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:59.213825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297541d5-5a61-4727-98fc-0da35fadf25e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:59.233967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 517/1038] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:33:59 2022] GET /identity/v3/role_assignments?user.id=0f46cf6eb4a44a71bda92cb212a8009c&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=f8e83f8093fd4211ba9af2015d7f0fa1 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:59.233967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297541d5-5a61-4727-98fc-0da35fadf25e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:59.259979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:59.323096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db5bd-f7a7-462e-bc29-1eec7150dd68 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:59.336034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297541d5-5a61-4727-98fc-0da35fadf25e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:59.354560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:59.362801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d1fc-0495-41bd-819a-242adc4eedfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:59.368109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d1fc-0495-41bd-819a-242adc4eedfe None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.368109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d1fc-0495-41bd-819a-242adc4eedfe None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.368109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d1fc-0495-41bd-819a-242adc4eedfe None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.368109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d1fc-0495-41bd-819a-242adc4eedfe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:59.368109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d1fc-0495-41bd-819a-242adc4eedfe None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:59.376040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba189359-d0b5-4dab-b39c-8cfc3acf17e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:59.376707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189359-d0b5-4dab-b39c-8cfc3acf17e8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.377000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189359-d0b5-4dab-b39c-8cfc3acf17e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.377280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189359-d0b5-4dab-b39c-8cfc3acf17e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.378109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba189359-d0b5-4dab-b39c-8cfc3acf17e8 None admin] RBAC: Adding query filter params (interface=public, service_id=afc0506797c24241910c7eb23621e10b, region_id=RegionOne) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:33:59.378429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba189359-d0b5-4dab-b39c-8cfc3acf17e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:59.380606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba189359-d0b5-4dab-b39c-8cfc3acf17e8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:59.389540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 518/1039] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 10:33:59 2022] GET /identity/v3/endpoints?service_id=afc0506797c24241910c7eb23621e10b&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:33:59.395068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba189359-d0b5-4dab-b39c-8cfc3acf17e8 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:59.454053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 522/1040] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:33:59 2022] POST /identity/v3/projects => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:33:59.498300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:59.502990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba189359-d0b5-4dab-b39c-8cfc3acf17e8 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:59.541097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395656a-2d92-4c51-92ec-fdcedee5dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:59.541838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395656a-2d92-4c51-92ec-fdcedee5dca1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.542159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395656a-2d92-4c51-92ec-fdcedee5dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.542440 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395656a-2d92-4c51-92ec-fdcedee5dca1 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.543130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395656a-2d92-4c51-92ec-fdcedee5dca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:59.544528 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395656a-2d92-4c51-92ec-fdcedee5dca1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:59.557972 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 519/1041] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 10:33:59 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:34:01.218126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee7dea-b045-4a32-b297-c75f373ece33 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.218623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee7dea-b045-4a32-b297-c75f373ece33 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.218623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee7dea-b045-4a32-b297-c75f373ece33 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.219990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 523/1042] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:01.225405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00324b38-d76b-44c7-8aa2-ae6961ec786f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.226302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00324b38-d76b-44c7-8aa2-ae6961ec786f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.226522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00324b38-d76b-44c7-8aa2-ae6961ec786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.243669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-00324b38-d76b-44c7-8aa2-ae6961ec786f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:01.244826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-00324b38-d76b-44c7-8aa2-ae6961ec786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:01.310712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 520/1043] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:01.332745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee7dea-b045-4a32-b297-c75f373ece33 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.435918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee7dea-b045-4a32-b297-c75f373ece33 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.470607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0294d83-b49b-415d-9cc5-6bfa28ec71f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.471344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294d83-b49b-415d-9cc5-6bfa28ec71f8 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.471628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294d83-b49b-415d-9cc5-6bfa28ec71f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.471900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294d83-b49b-415d-9cc5-6bfa28ec71f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.483264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0294d83-b49b-415d-9cc5-6bfa28ec71f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-a0294d83-b49b-415d-9cc5-6bfa28ec71f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:01.491223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:01.492763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:34:01.493644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:01.497920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 524/1044] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:01.499207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00324b38-d76b-44c7-8aa2-ae6961ec786f None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.523504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf59d9-a6d0-4c38-8d37-08ca30c54b41 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.523797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf59d9-a6d0-4c38-8d37-08ca30c54b41 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.524077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf59d9-a6d0-4c38-8d37-08ca30c54b41 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.525559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 525/1045] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:34:01.532102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be894ff-b9fa-4e57-abfe-270bd476cdd3 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.536623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be894ff-b9fa-4e57-abfe-270bd476cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.538150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be894ff-b9fa-4e57-abfe-270bd476cdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.559729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7be894ff-b9fa-4e57-abfe-270bd476cdd3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:01.560926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7be894ff-b9fa-4e57-abfe-270bd476cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:01.596863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:01.602489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:01.606169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00324b38-d76b-44c7-8aa2-ae6961ec786f None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.635207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 526/1046] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:34:01.636633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f347-55a5-408d-906a-9c7af3617b34 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.637171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f347-55a5-408d-906a-9c7af3617b34 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.637320 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f347-55a5-408d-906a-9c7af3617b34 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.638863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 527/1047] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:01.641732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6c087-c50d-48b0-ab42-d94b910dbe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.642527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6c087-c50d-48b0-ab42-d94b910dbe16 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.643195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6c087-c50d-48b0-ab42-d94b910dbe16 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.643788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6c087-c50d-48b0-ab42-d94b910dbe16 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.644146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3852-acb2-4a87-aab9-f92225187c07 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.644442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3852-acb2-4a87-aab9-f92225187c07 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.648517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3852-acb2-4a87-aab9-f92225187c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.648626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6c087-c50d-48b0-ab42-d94b910dbe16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:01.648626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6c087-c50d-48b0-ab42-d94b910dbe16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.648626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6c087-c50d-48b0-ab42-d94b910dbe16 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.656337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 521/1048] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:01.660932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6c087-c50d-48b0-ab42-d94b910dbe16 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.664149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-177b3852-acb2-4a87-aab9-f92225187c07 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:01.665449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-177b3852-acb2-4a87-aab9-f92225187c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:01.734366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 528/1049] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:01.735135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3852-acb2-4a87-aab9-f92225187c07 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.762465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6c087-c50d-48b0-ab42-d94b910dbe16 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.795766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa062af9-f094-4351-af4a-d22fe9061ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.796555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa062af9-f094-4351-af4a-d22fe9061ae2 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.796876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa062af9-f094-4351-af4a-d22fe9061ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.797120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa062af9-f094-4351-af4a-d22fe9061ae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.798380 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa062af9-f094-4351-af4a-d22fe9061ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.799818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa062af9-f094-4351-af4a-d22fe9061ae2 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.806300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 522/1050] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:01.806300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa062af9-f094-4351-af4a-d22fe9061ae2 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.825697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:01.832794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:01.836145 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3852-acb2-4a87-aab9-f92225187c07 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.870077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12d901-86c4-4567-9d3c-be59dab314e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.870868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12d901-86c4-4567-9d3c-be59dab314e8 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.871155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12d901-86c4-4567-9d3c-be59dab314e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.871434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12d901-86c4-4567-9d3c-be59dab314e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.881421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12d901-86c4-4567-9d3c-be59dab314e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.883008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12d901-86c4-4567-9d3c-be59dab314e8 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.901535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa062af9-f094-4351-af4a-d22fe9061ae2 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-2f12d901-86c4-4567-9d3c-be59dab314e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:34:01.903435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:01.904566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:01.905535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:34:01.905535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:34:01.905535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:01.905535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:01.905535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 529/1051] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:01.905829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12d901-86c4-4567-9d3c-be59dab314e8 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.937890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166c01-0e12-4820-ab62-8e4c7fdf2284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.938740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166c01-0e12-4820-ab62-8e4c7fdf2284 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.939120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166c01-0e12-4820-ab62-8e4c7fdf2284 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.939428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166c01-0e12-4820-ab62-8e4c7fdf2284 None admin] PATH_INFO: `/v3/services/image` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.940084 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39166c01-0e12-4820-ab62-8e4c7fdf2284 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.941454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39166c01-0e12-4820-ab62-8e4c7fdf2284 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-39166c01-0e12-4820-ab62-8e4c7fdf2284 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:01.952932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:01.953920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:01.954856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 523/1052] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:01.955645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166c01-0e12-4820-ab62-8e4c7fdf2284 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:02.015554 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12d901-86c4-4567-9d3c-be59dab314e8 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:02.039581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:02.049466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560155f-886a-4115-96a7-122ce0b62fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:02.050167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560155f-886a-4115-96a7-122ce0b62fe8 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:02.050464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560155f-886a-4115-96a7-122ce0b62fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:02.050740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560155f-886a-4115-96a7-122ce0b62fe8 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:02.051450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560155f-886a-4115-96a7-122ce0b62fe8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:02.052914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560155f-886a-4115-96a7-122ce0b62fe8 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:02.053961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166c01-0e12-4820-ab62-8e4c7fdf2284 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:02.088142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd78c4e-6c2e-4653-ab9d-c9b125bcc3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:02.088814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd78c4e-6c2e-4653-ab9d-c9b125bcc3e5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:02.089126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd78c4e-6c2e-4653-ab9d-c9b125bcc3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:02.089409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd78c4e-6c2e-4653-ab9d-c9b125bcc3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:02.090175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd78c4e-6c2e-4653-ab9d-c9b125bcc3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:02.090490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd78c4e-6c2e-4653-ab9d-c9b125bcc3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:02.091856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd78c4e-6c2e-4653-ab9d-c9b125bcc3e5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:02.103743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 524/1053] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:02.104509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd78c4e-6c2e-4653-ab9d-c9b125bcc3e5 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:02.150817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 530/1054] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:02.151735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560155f-886a-4115-96a7-122ce0b62fe8 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:02.164565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:02.211467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd78c4e-6c2e-4653-ab9d-c9b125bcc3e5 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:02.251074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe77b1-82f7-4e06-acb8-6cfdc44790ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:02.251879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe77b1-82f7-4e06-acb8-6cfdc44790ce None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:02.252048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe77b1-82f7-4e06-acb8-6cfdc44790ce None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:02.252336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe77b1-82f7-4e06-acb8-6cfdc44790ce None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:02.253066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe77b1-82f7-4e06-acb8-6cfdc44790ce None admin] RBAC: Adding query filter params (name=image) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:02.253451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe77b1-82f7-4e06-acb8-6cfdc44790ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:02.254955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe77b1-82f7-4e06-acb8-6cfdc44790ce None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:02.261983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 525/1055] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:02.267849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe77b1-82f7-4e06-acb8-6cfdc44790ce None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:02.274910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560155f-886a-4115-96a7-122ce0b62fe8 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:02.280809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:02.316830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b9113-5b7a-4f9a-bd13-cd60722599a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:02.317634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9113-5b7a-4f9a-bd13-cd60722599a1 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:02.317918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9113-5b7a-4f9a-bd13-cd60722599a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:02.318219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9113-5b7a-4f9a-bd13-cd60722599a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:02.327753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b9113-5b7a-4f9a-bd13-cd60722599a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:02.329204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b9113-5b7a-4f9a-bd13-cd60722599a1 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-0f1b9113-5b7a-4f9a-bd13-cd60722599a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:34:02.347660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:02.348887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:02.350147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 531/1056] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 10:34:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:02.354640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b9113-5b7a-4f9a-bd13-cd60722599a1 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:02.388993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe77b1-82f7-4e06-acb8-6cfdc44790ce None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:02.426084 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b12e08-b915-4965-bad4-04a9040d0b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:02.426748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12e08-b915-4965-bad4-04a9040d0b52 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:02.427031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12e08-b915-4965-bad4-04a9040d0b52 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:02.427304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12e08-b915-4965-bad4-04a9040d0b52 None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:02.428009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b12e08-b915-4965-bad4-04a9040d0b52 None admin] RBAC: Adding query filter params (type=image) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:02.428322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b12e08-b915-4965-bad4-04a9040d0b52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:02.430249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b12e08-b915-4965-bad4-04a9040d0b52 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:02.430944 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:02.435306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 526/1057] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:02.441143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b12e08-b915-4965-bad4-04a9040d0b52 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:02.466689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b9113-5b7a-4f9a-bd13-cd60722599a1 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:02.501008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae810a6-f911-4850-bcd3-823e01d9bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:02.501695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae810a6-f911-4850-bcd3-823e01d9bfe5 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:02.501986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae810a6-f911-4850-bcd3-823e01d9bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:02.502287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae810a6-f911-4850-bcd3-823e01d9bfe5 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:02.503111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae810a6-f911-4850-bcd3-823e01d9bfe5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:02.503424 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae810a6-f911-4850-bcd3-823e01d9bfe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:02.504855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae810a6-f911-4850-bcd3-823e01d9bfe5 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:02.523696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 532/1058] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 10:34:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:02.529117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:02.529268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae810a6-f911-4850-bcd3-823e01d9bfe5 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:02.554795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b12e08-b915-4965-bad4-04a9040d0b52 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:02.591211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fec7c6-38dd-4512-8af8-84c52c4200f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:02.592207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fec7c6-38dd-4512-8af8-84c52c4200f6 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:02.592658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fec7c6-38dd-4512-8af8-84c52c4200f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:02.592941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fec7c6-38dd-4512-8af8-84c52c4200f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:02.593690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fec7c6-38dd-4512-8af8-84c52c4200f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:02.595118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fec7c6-38dd-4512-8af8-84c52c4200f6 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:02.633066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae810a6-f911-4850-bcd3-823e01d9bfe5 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:02.658632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:02.667086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54db88-30be-4b35-8380-c6765e846c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:02.667876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54db88-30be-4b35-8380-c6765e846c9b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:02.668158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54db88-30be-4b35-8380-c6765e846c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:02.668431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54db88-30be-4b35-8380-c6765e846c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:02.680680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54db88-30be-4b35-8380-c6765e846c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:02.682152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54db88-30be-4b35-8380-c6765e846c9b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:02.686011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 527/1059] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 10:34:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-9d54db88-30be-4b35-8380-c6765e846c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:34:02.703133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:02.709847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:02.710855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:34:02.710855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:34:02.710855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:02.710855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:02.710855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 533/1060] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:34:02.712796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fec7c6-38dd-4512-8af8-84c52c4200f6 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:02.828672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fec7c6-38dd-4512-8af8-84c52c4200f6 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:02.858133 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:02.869562 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c3909-f311-4bf2-a1e2-c05e014b5a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:02.870274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c3909-f311-4bf2-a1e2-c05e014b5a1e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:02.870563 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c3909-f311-4bf2-a1e2-c05e014b5a1e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:02.870842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c3909-f311-4bf2-a1e2-c05e014b5a1e None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:02.871581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c3909-f311-4bf2-a1e2-c05e014b5a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:02.872452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c3909-f311-4bf2-a1e2-c05e014b5a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:02.878926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c3909-f311-4bf2-a1e2-c05e014b5a1e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:02.891600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 528/1061] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:02.898997 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54db88-30be-4b35-8380-c6765e846c9b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:03.010908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54db88-30be-4b35-8380-c6765e846c9b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:03.045652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda13684-9f5f-4507-a471-11c2bc595cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:03.046471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda13684-9f5f-4507-a471-11c2bc595cbd None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:03.046756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda13684-9f5f-4507-a471-11c2bc595cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:03.047033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda13684-9f5f-4507-a471-11c2bc595cbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:03.053670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda13684-9f5f-4507-a471-11c2bc595cbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:03.055713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda13684-9f5f-4507-a471-11c2bc595cbd None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-cda13684-9f5f-4507-a471-11c2bc595cbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:34:03.069261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:03.070617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:03.071532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:34:03.071532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:34:03.071532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:34:03.071532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:34:03.071532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:34:03.071532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:34:03.071532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:34:03.071532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:03.071532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 534/1062] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:03.078209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c3909-f311-4bf2-a1e2-c05e014b5a1e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:03.176543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c3909-f311-4bf2-a1e2-c05e014b5a1e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:03.211312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65327bc5-8132-4190-8201-bb088633b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:03.211976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65327bc5-8132-4190-8201-bb088633b378 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:03.212259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65327bc5-8132-4190-8201-bb088633b378 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:03.212539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65327bc5-8132-4190-8201-bb088633b378 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:03.213334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65327bc5-8132-4190-8201-bb088633b378 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:03.213645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65327bc5-8132-4190-8201-bb088633b378 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:03.215230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65327bc5-8132-4190-8201-bb088633b378 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:03.228677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 529/1063] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:03.234467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda13684-9f5f-4507-a471-11c2bc595cbd None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:03.277967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:03.340238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda13684-9f5f-4507-a471-11c2bc595cbd None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:03.376892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce969f2-8fd9-42bc-b631-c597db6c658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:03.377785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce969f2-8fd9-42bc-b631-c597db6c658c None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:03.378092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce969f2-8fd9-42bc-b631-c597db6c658c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:03.378366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce969f2-8fd9-42bc-b631-c597db6c658c None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/0f46cf6eb4a44a71bda92cb212a8009c/roles/f8e83f8093fd4211ba9af2015d7f0fa1` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:03.380543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce969f2-8fd9-42bc-b631-c597db6c658c None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=0f46cf6eb4a44a71bda92cb212a8009c, role_id=f8e83f8093fd4211ba9af2015d7f0fa1)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:03.382319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce969f2-8fd9-42bc-b631-c597db6c658c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:03.462016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 535/1064] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:34:03 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/0f46cf6eb4a44a71bda92cb212a8009c/roles/f8e83f8093fd4211ba9af2015d7f0fa1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:34:04.336566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895aa42-d4c6-42d2-9e39-081279d4299b None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:04.337118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895aa42-d4c6-42d2-9e39-081279d4299b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:04.337118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895aa42-d4c6-42d2-9e39-081279d4299b None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:04.338695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 530/1065] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:04.343944 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a18dc-b83e-4ef3-8673-57a3eb9704d0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:04.344548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a18dc-b83e-4ef3-8673-57a3eb9704d0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:04.344548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a18dc-b83e-4ef3-8673-57a3eb9704d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:04.361765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b12a18dc-b83e-4ef3-8673-57a3eb9704d0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:04.362991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b12a18dc-b83e-4ef3-8673-57a3eb9704d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:04.433991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 536/1066] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:04.456488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895aa42-d4c6-42d2-9e39-081279d4299b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:04.504789 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:04.560416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895aa42-d4c6-42d2-9e39-081279d4299b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:04.596688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fafeb-286f-41c0-9499-268ca5b7b8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:04.597653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fafeb-286f-41c0-9499-268ca5b7b8ef None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:04.597965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fafeb-286f-41c0-9499-268ca5b7b8ef None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:04.598252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fafeb-286f-41c0-9499-268ca5b7b8ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:04.608403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fafeb-286f-41c0-9499-268ca5b7b8ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-a23fafeb-286f-41c0-9499-268ca5b7b8ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:04.616057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:04.621250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:04.622465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 531/1067] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:04.623922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a18dc-b83e-4ef3-8673-57a3eb9704d0 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:04.652525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:04.727417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a18dc-b83e-4ef3-8673-57a3eb9704d0 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:04.762385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5057e46-25fb-4276-8460-b1656e691a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:04.763266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5057e46-25fb-4276-8460-b1656e691a6e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:04.763732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5057e46-25fb-4276-8460-b1656e691a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:04.764179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5057e46-25fb-4276-8460-b1656e691a6e None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:04.765069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5057e46-25fb-4276-8460-b1656e691a6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:04.765537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5057e46-25fb-4276-8460-b1656e691a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:04.767085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5057e46-25fb-4276-8460-b1656e691a6e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:04.775821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 537/1068] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:04.781388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fafeb-286f-41c0-9499-268ca5b7b8ef None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:04.795699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e75be9-cd54-4720-a0f7-21531e700734 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:04.795994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e75be9-cd54-4720-a0f7-21531e700734 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:04.796277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e75be9-cd54-4720-a0f7-21531e700734 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:04.797732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 538/1069] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:34:04.802874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79551cd9-b94f-46b4-90b7-b0ffa3e900ae None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:04.803175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79551cd9-b94f-46b4-90b7-b0ffa3e900ae None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:04.803461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79551cd9-b94f-46b4-90b7-b0ffa3e900ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:04.822428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-79551cd9-b94f-46b4-90b7-b0ffa3e900ae None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:04.824032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-79551cd9-b94f-46b4-90b7-b0ffa3e900ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:04.886894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fafeb-286f-41c0-9499-268ca5b7b8ef None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:04.896215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:04.901259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 539/1070] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:34:04.924134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79551cd9-b94f-46b4-90b7-b0ffa3e900ae None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:04.933178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8da636-9958-4ea0-86c0-85cff81db01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:04.934079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8da636-9958-4ea0-86c0-85cff81db01f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:04.934369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8da636-9958-4ea0-86c0-85cff81db01f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:04.934648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8da636-9958-4ea0-86c0-85cff81db01f None admin] PATH_INFO: `/v3/users/93c1aa02d83a43ea872ea990b346a92b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:04.948476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:04.948876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8da636-9958-4ea0-86c0-85cff81db01f None admin] RBAC: Authorizing `identity:get_user(user_id=93c1aa02d83a43ea872ea990b346a92b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:04.950354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8da636-9958-4ea0-86c0-85cff81db01f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:04.952061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 532/1071] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:04 2022] GET /identity/v3/users/93c1aa02d83a43ea872ea990b346a92b => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:04.957701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8da636-9958-4ea0-86c0-85cff81db01f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:05.040774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79551cd9-b94f-46b4-90b7-b0ffa3e900ae None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:05.068913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8da636-9958-4ea0-86c0-85cff81db01f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:05.078587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711bf8-82e3-48c7-8a5b-ec192b22452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:05.079243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711bf8-82e3-48c7-8a5b-ec192b22452b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:05.079533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711bf8-82e3-48c7-8a5b-ec192b22452b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:05.079815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711bf8-82e3-48c7-8a5b-ec192b22452b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:05.105132 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda37ba-bd62-46cf-9458-b99f39fa06ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:05.106090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda37ba-bd62-46cf-9458-b99f39fa06ed None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:05.106382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda37ba-bd62-46cf-9458-b99f39fa06ed None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:05.106675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda37ba-bd62-46cf-9458-b99f39fa06ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:05.138771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:05.156967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1711bf8-82e3-48c7-8a5b-ec192b22452b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:05.158491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1711bf8-82e3-48c7-8a5b-ec192b22452b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:05.177334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda37ba-bd62-46cf-9458-b99f39fa06ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:05.179405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda37ba-bd62-46cf-9458-b99f39fa06ed None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:05.181728 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:05.269581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 540/1072] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:34:05.271024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711bf8-82e3-48c7-8a5b-ec192b22452b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:05.287848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 533/1073] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:34:05.294374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda37ba-bd62-46cf-9458-b99f39fa06ed None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:05.356073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:05.384235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711bf8-82e3-48c7-8a5b-ec192b22452b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:05.393673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda37ba-bd62-46cf-9458-b99f39fa06ed None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:05.405630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:05.421458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0992-2d3a-4fb8-b6ec-b91c4a738d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:05.422374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0992-2d3a-4fb8-b6ec-b91c4a738d98 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:05.422671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0992-2d3a-4fb8-b6ec-b91c4a738d98 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:05.422949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0992-2d3a-4fb8-b6ec-b91c4a738d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:05.430865 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7c75f-a55a-4297-aca7-5cf174662455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:05.431957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c75f-a55a-4297-aca7-5cf174662455 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:05.432437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c75f-a55a-4297-aca7-5cf174662455 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:05.432788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c75f-a55a-4297-aca7-5cf174662455 None admin] PATH_INFO: `/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:05.433299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b0992-2d3a-4fb8-b6ec-b91c4a738d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:05.434003 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7c75f-a55a-4297-aca7-5cf174662455 None admin] RBAC: Authorizing `identity:get_project(project_id=c59be571f2d647fa97c7bb9bcdea6fae)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:05.434786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b0992-2d3a-4fb8-b6ec-b91c4a738d98 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:05.435424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7c75f-a55a-4297-aca7-5cf174662455 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:05.437487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 534/1074] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:05 2022] GET /identity/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:05.443056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7c75f-a55a-4297-aca7-5cf174662455 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-6a0b0992-2d3a-4fb8-b6ec-b91c4a738d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:34:05.459259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:05.460743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:05.461649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:34:05.461649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:34:05.461649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:05.461649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:05.461649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 541/1075] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:34:05.466776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0992-2d3a-4fb8-b6ec-b91c4a738d98 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:05.547958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7c75f-a55a-4297-aca7-5cf174662455 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:05.569964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0992-2d3a-4fb8-b6ec-b91c4a738d98 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:05.576669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:05.581416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd20aaf-f2a1-449b-a389-5915dc0a140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:05.582094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20aaf-f2a1-449b-a389-5915dc0a140f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:05.582384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20aaf-f2a1-449b-a389-5915dc0a140f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:05.584158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20aaf-f2a1-449b-a389-5915dc0a140f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:05.584158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd20aaf-f2a1-449b-a389-5915dc0a140f None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=c59be571f2d647fa97c7bb9bcdea6fae, user.id=93c1aa02d83a43ea872ea990b346a92b) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:05.584158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd20aaf-f2a1-449b-a389-5915dc0a140f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:05.585806 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd20aaf-f2a1-449b-a389-5915dc0a140f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:05.591362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 535/1076] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:34:05 2022] GET /identity/v3/role_assignments?user.id=93c1aa02d83a43ea872ea990b346a92b&scope.project.id=c59be571f2d647fa97c7bb9bcdea6fae&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:05.592522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc28b4-5423-45b3-8709-bdef736d03a3 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:05.592810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc28b4-5423-45b3-8709-bdef736d03a3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:05.593086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc28b4-5423-45b3-8709-bdef736d03a3 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:05.594505 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 536/1077] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:05.600379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f979c6-8306-4366-a850-2f29dc4e5762 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:05.601587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f979c6-8306-4366-a850-2f29dc4e5762 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:05.601961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f979c6-8306-4366-a850-2f29dc4e5762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:05.609239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7513d97-59c2-4259-8be8-e2f56519902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:05.610385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7513d97-59c2-4259-8be8-e2f56519902f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:05.610673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7513d97-59c2-4259-8be8-e2f56519902f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:05.610949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7513d97-59c2-4259-8be8-e2f56519902f None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:05.611696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7513d97-59c2-4259-8be8-e2f56519902f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:05.612007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7513d97-59c2-4259-8be8-e2f56519902f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:05.613510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7513d97-59c2-4259-8be8-e2f56519902f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:05.620832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-21f979c6-8306-4366-a850-2f29dc4e5762 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:05.622094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-21f979c6-8306-4366-a850-2f29dc4e5762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:05.627005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 542/1078] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:05.713933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 537/1079] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:34:05.739471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7513d97-59c2-4259-8be8-e2f56519902f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:05.779510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:05.854339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7513d97-59c2-4259-8be8-e2f56519902f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:05.891669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b41d0-38df-4262-96d0-44467bd8d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:05.891669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b41d0-38df-4262-96d0-44467bd8d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:05.891669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b41d0-38df-4262-96d0-44467bd8d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:05.891669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b41d0-38df-4262-96d0-44467bd8d4c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:05.903592 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b41d0-38df-4262-96d0-44467bd8d4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-a89b41d0-38df-4262-96d0-44467bd8d4c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:05.911753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:05.912671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:05.914013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 543/1080] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jun 30 10:34:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:05.919370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f979c6-8306-4366-a850-2f29dc4e5762 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:06.018879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f979c6-8306-4366-a850-2f29dc4e5762 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:06.044786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:06.053532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bbd2a-280e-4c27-9a4a-bed6b005bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:06.054229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bbd2a-280e-4c27-9a4a-bed6b005bdd4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:06.054516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bbd2a-280e-4c27-9a4a-bed6b005bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:06.054795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bbd2a-280e-4c27-9a4a-bed6b005bdd4 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:06.061071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bbd2a-280e-4c27-9a4a-bed6b005bdd4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:06.061071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bbd2a-280e-4c27-9a4a-bed6b005bdd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:06.061071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bbd2a-280e-4c27-9a4a-bed6b005bdd4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:06.065318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 538/1081] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 10:34:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:06.071344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b41d0-38df-4262-96d0-44467bd8d4c7 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:06.161292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:06.170119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b41d0-38df-4262-96d0-44467bd8d4c7 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:06.203661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ab6de-158c-44a6-a8ff-6b65974cf34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:06.204449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ab6de-158c-44a6-a8ff-6b65974cf34e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:06.204741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ab6de-158c-44a6-a8ff-6b65974cf34e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:06.205023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ab6de-158c-44a6-a8ff-6b65974cf34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:06.215573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ab6de-158c-44a6-a8ff-6b65974cf34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:06.217023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ab6de-158c-44a6-a8ff-6b65974cf34e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-339ab6de-158c-44a6-a8ff-6b65974cf34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:34:06.234051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:06.235131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:06.236068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:34:06.236068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:34:06.236068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:06.236068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:06.236068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 544/1082] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:06.240935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bbd2a-280e-4c27-9a4a-bed6b005bdd4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:06.337591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bbd2a-280e-4c27-9a4a-bed6b005bdd4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:06.369882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cd7ae-8642-45a7-95c3-4c17a0562d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:06.370561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd7ae-8642-45a7-95c3-4c17a0562d90 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:06.370844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd7ae-8642-45a7-95c3-4c17a0562d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:06.371118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd7ae-8642-45a7-95c3-4c17a0562d90 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:06.371838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cd7ae-8642-45a7-95c3-4c17a0562d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:06.372144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cd7ae-8642-45a7-95c3-4c17a0562d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:06.373494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cd7ae-8642-45a7-95c3-4c17a0562d90 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:06.385457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 539/1083] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:06.391087 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ab6de-158c-44a6-a8ff-6b65974cf34e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:06.487508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ab6de-158c-44a6-a8ff-6b65974cf34e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:06.519663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbd3c2-ef2e-441c-9b47-95b00684741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:06.520433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd3c2-ef2e-441c-9b47-95b00684741b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:06.520716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd3c2-ef2e-441c-9b47-95b00684741b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:06.520991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd3c2-ef2e-441c-9b47-95b00684741b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:06.528267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbd3c2-ef2e-441c-9b47-95b00684741b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:06.529690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbd3c2-ef2e-441c-9b47-95b00684741b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-79cbd3c2-ef2e-441c-9b47-95b00684741b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:34:06.543855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:06.544830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:06.546203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 545/1084] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jun 30 10:34:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:34:06.550626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cd7ae-8642-45a7-95c3-4c17a0562d90 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:06.598345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:06.648004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cd7ae-8642-45a7-95c3-4c17a0562d90 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:06.714712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34472968-4f02-45d9-a201-7d9f6dc6a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:06.715380 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472968-4f02-45d9-a201-7d9f6dc6a1af None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:06.715663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472968-4f02-45d9-a201-7d9f6dc6a1af None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:06.715937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472968-4f02-45d9-a201-7d9f6dc6a1af None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:06.716773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34472968-4f02-45d9-a201-7d9f6dc6a1af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:06.717089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34472968-4f02-45d9-a201-7d9f6dc6a1af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:06.718548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34472968-4f02-45d9-a201-7d9f6dc6a1af None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:06.736037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 540/1085] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jun 30 10:34:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:06.742328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbd3c2-ef2e-441c-9b47-95b00684741b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:06.746178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:06.839863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbd3c2-ef2e-441c-9b47-95b00684741b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:06.872982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451c05b-1299-48ae-9286-95daabc2460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:06.873556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451c05b-1299-48ae-9286-95daabc2460f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:06.873839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451c05b-1299-48ae-9286-95daabc2460f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:06.874143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451c05b-1299-48ae-9286-95daabc2460f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:06.941988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451c05b-1299-48ae-9286-95daabc2460f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:06.943425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451c05b-1299-48ae-9286-95daabc2460f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:06.946012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:07.041406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 546/1086] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:34:07.047092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34472968-4f02-45d9-a201-7d9f6dc6a1af None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:07.150437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34472968-4f02-45d9-a201-7d9f6dc6a1af None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:07.157447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:07.183895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff938ec-7747-47e9-a0d3-27b3541f589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:07.184683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff938ec-7747-47e9-a0d3-27b3541f589f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:07.184966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff938ec-7747-47e9-a0d3-27b3541f589f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:07.185246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff938ec-7747-47e9-a0d3-27b3541f589f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:07.195641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff938ec-7747-47e9-a0d3-27b3541f589f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:07.197072 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff938ec-7747-47e9-a0d3-27b3541f589f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-bff938ec-7747-47e9-a0d3-27b3541f589f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:34:07.214905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:07.216083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:07.216987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:34:07.216987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:34:07.216987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:34:07.216987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:07.216987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 541/1087] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:07.221685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451c05b-1299-48ae-9286-95daabc2460f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:07.325046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451c05b-1299-48ae-9286-95daabc2460f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:07.327446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:07.359540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836ff4f-6037-4a01-b7c4-80ffe87d4908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:07.360206 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836ff4f-6037-4a01-b7c4-80ffe87d4908 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:07.360491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836ff4f-6037-4a01-b7c4-80ffe87d4908 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:07.360769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836ff4f-6037-4a01-b7c4-80ffe87d4908 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:07.361489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836ff4f-6037-4a01-b7c4-80ffe87d4908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:07.361799 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836ff4f-6037-4a01-b7c4-80ffe87d4908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:07.363205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836ff4f-6037-4a01-b7c4-80ffe87d4908 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:07.374812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 547/1088] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:07.380332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff938ec-7747-47e9-a0d3-27b3541f589f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:07.477653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff938ec-7747-47e9-a0d3-27b3541f589f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:07.511444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cc178-92d8-4eb9-967b-609907965ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:07.512237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cc178-92d8-4eb9-967b-609907965ed3 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:07.512523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cc178-92d8-4eb9-967b-609907965ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:07.512809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cc178-92d8-4eb9-967b-609907965ed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:07.519348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cc178-92d8-4eb9-967b-609907965ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:07.520784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cc178-92d8-4eb9-967b-609907965ed3 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-c02cc178-92d8-4eb9-967b-609907965ed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:34:07.534810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:07.535672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:07.536583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:34:07.536583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:34:07.536583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:34:07.536583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:34:07.536583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:34:07.536583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:34:07.536583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:34:07.536583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:07.536583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 542/1089] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:07.541831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836ff4f-6037-4a01-b7c4-80ffe87d4908 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:07.620723 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8ad76-dbd1-4139-877b-644a546a2179 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:07.621011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8ad76-dbd1-4139-877b-644a546a2179 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:07.621293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8ad76-dbd1-4139-877b-644a546a2179 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:07.622810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 543/1090] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:34:07.627745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2a2d9-b3fa-490b-80f2-d888bea5e60c None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:07.628042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2a2d9-b3fa-490b-80f2-d888bea5e60c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:07.628325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2a2d9-b3fa-490b-80f2-d888bea5e60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:07.645205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836ff4f-6037-4a01-b7c4-80ffe87d4908 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:07.646344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-01c2a2d9-b3fa-490b-80f2-d888bea5e60c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:07.647533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-01c2a2d9-b3fa-490b-80f2-d888bea5e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:07.660445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:07.680738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca0d88-a800-43ea-8cb3-bfe2f5d46db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:07.681398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca0d88-a800-43ea-8cb3-bfe2f5d46db4 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:07.681682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca0d88-a800-43ea-8cb3-bfe2f5d46db4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:07.681982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca0d88-a800-43ea-8cb3-bfe2f5d46db4 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:07.682829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca0d88-a800-43ea-8cb3-bfe2f5d46db4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:07.683139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca0d88-a800-43ea-8cb3-bfe2f5d46db4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:07.684569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca0d88-a800-43ea-8cb3-bfe2f5d46db4 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:07.697603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 548/1091] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:07.703776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca0d88-a800-43ea-8cb3-bfe2f5d46db4 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:07.713567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 544/1092] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:34:07.728058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:07.736443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2a2d9-b3fa-490b-80f2-d888bea5e60c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:07.800090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca0d88-a800-43ea-8cb3-bfe2f5d46db4 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:07.832633 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2a2d9-b3fa-490b-80f2-d888bea5e60c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:07.833789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c369644-fe2b-4754-9861-e3677c2850ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:07.834456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c369644-fe2b-4754-9861-e3677c2850ed None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:07.834764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c369644-fe2b-4754-9861-e3677c2850ed None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:07.835046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c369644-fe2b-4754-9861-e3677c2850ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:07.835862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c369644-fe2b-4754-9861-e3677c2850ed None admin] RBAC: Adding query filter params (role.id=f8e83f8093fd4211ba9af2015d7f0fa1, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=0f46cf6eb4a44a71bda92cb212a8009c) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:07.836170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c369644-fe2b-4754-9861-e3677c2850ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:07.837596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c369644-fe2b-4754-9861-e3677c2850ed None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:07.843346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 549/1093] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:34:07 2022] GET /identity/v3/role_assignments?user.id=0f46cf6eb4a44a71bda92cb212a8009c&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=f8e83f8093fd4211ba9af2015d7f0fa1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:07.869111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b48878-da29-48d3-bb8f-11ee06eb8b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:07.869961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b48878-da29-48d3-bb8f-11ee06eb8b38 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:07.870262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b48878-da29-48d3-bb8f-11ee06eb8b38 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:07.870544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b48878-da29-48d3-bb8f-11ee06eb8b38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:07.883249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b48878-da29-48d3-bb8f-11ee06eb8b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-a8b48878-da29-48d3-bb8f-11ee06eb8b38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:07.891231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:07.892251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:07.893108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 545/1094] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:34:07.899083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c369644-fe2b-4754-9861-e3677c2850ed None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:07.992590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:08.004939 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c369644-fe2b-4754-9861-e3677c2850ed None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:08.040301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86732c6-11e9-435c-b3c0-ad6cdb328e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:08.040964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86732c6-11e9-435c-b3c0-ad6cdb328e6e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:08.041247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86732c6-11e9-435c-b3c0-ad6cdb328e6e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:08.041523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86732c6-11e9-435c-b3c0-ad6cdb328e6e None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:08.042297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86732c6-11e9-435c-b3c0-ad6cdb328e6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:08.042608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86732c6-11e9-435c-b3c0-ad6cdb328e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:08.044011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86732c6-11e9-435c-b3c0-ad6cdb328e6e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:08.052578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 550/1095] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:08.058982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b48878-da29-48d3-bb8f-11ee06eb8b38 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:08.070608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:08.161059 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b48878-da29-48d3-bb8f-11ee06eb8b38 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:08.196834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb52aac-bb02-49ff-8471-255ec7183574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:08.197708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb52aac-bb02-49ff-8471-255ec7183574 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:08.198021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb52aac-bb02-49ff-8471-255ec7183574 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:08.198301 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb52aac-bb02-49ff-8471-255ec7183574 None admin] PATH_INFO: `/v3/users/93c1aa02d83a43ea872ea990b346a92b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:08.199484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb52aac-bb02-49ff-8471-255ec7183574 None admin] RBAC: Authorizing `identity:get_user(user_id=93c1aa02d83a43ea872ea990b346a92b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:08.200901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb52aac-bb02-49ff-8471-255ec7183574 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:08.202556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 546/1096] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:08 2022] GET /identity/v3/users/93c1aa02d83a43ea872ea990b346a92b => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:08.208634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86732c6-11e9-435c-b3c0-ad6cdb328e6e None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:08.311829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86732c6-11e9-435c-b3c0-ad6cdb328e6e None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:08.346212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48108b2-fb48-4520-82f2-fe36cd9100e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:08.347357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48108b2-fb48-4520-82f2-fe36cd9100e9 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:08.347648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48108b2-fb48-4520-82f2-fe36cd9100e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:08.347929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48108b2-fb48-4520-82f2-fe36cd9100e9 None admin] PATH_INFO: `/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:08.349122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48108b2-fb48-4520-82f2-fe36cd9100e9 None admin] RBAC: Authorizing `identity:get_project(project_id=c59be571f2d647fa97c7bb9bcdea6fae)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:08.351416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48108b2-fb48-4520-82f2-fe36cd9100e9 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:08.352989 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 551/1097] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:08 2022] GET /identity/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:08.358909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb52aac-bb02-49ff-8471-255ec7183574 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:08.440275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:08.463423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb52aac-bb02-49ff-8471-255ec7183574 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:08.498117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49457e8a-f489-413f-8ebe-c057ebdef774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:08.499010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49457e8a-f489-413f-8ebe-c057ebdef774 None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:08.499298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49457e8a-f489-413f-8ebe-c057ebdef774 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:08.499579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49457e8a-f489-413f-8ebe-c057ebdef774 None admin] PATH_INFO: `/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae/users/93c1aa02d83a43ea872ea990b346a92b/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:08.501526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49457e8a-f489-413f-8ebe-c057ebdef774 None admin] RBAC: Authorizing `identity:create_grant(project_id=c59be571f2d647fa97c7bb9bcdea6fae, user_id=93c1aa02d83a43ea872ea990b346a92b, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:08.502999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49457e8a-f489-413f-8ebe-c057ebdef774 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:08.602034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 547/1098] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:34:08 2022] PUT /identity/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae/users/93c1aa02d83a43ea872ea990b346a92b/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:10.650471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83f3a7-bc2c-4281-9b4d-a4150987a818 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.651003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83f3a7-bc2c-4281-9b4d-a4150987a818 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.651003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83f3a7-bc2c-4281-9b4d-a4150987a818 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.652377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 552/1099] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:10.657407 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9e5c9-ae0f-4329-a664-507b5338deca None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.657784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9e5c9-ae0f-4329-a664-507b5338deca None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.657985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9e5c9-ae0f-4329-a664-507b5338deca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.679913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-80d9e5c9-ae0f-4329-a664-507b5338deca None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:10.681901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-80d9e5c9-ae0f-4329-a664-507b5338deca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:10.748763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 548/1100] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:10.772746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83f3a7-bc2c-4281-9b4d-a4150987a818 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:10.793190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:10.872072 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83f3a7-bc2c-4281-9b4d-a4150987a818 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:10.905225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf65e7-349e-4351-b86c-dbebb8dafd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:10.905959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf65e7-349e-4351-b86c-dbebb8dafd8d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.906257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf65e7-349e-4351-b86c-dbebb8dafd8d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.906534 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf65e7-349e-4351-b86c-dbebb8dafd8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.917365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf65e7-349e-4351-b86c-dbebb8dafd8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-5eaf65e7-349e-4351-b86c-dbebb8dafd8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:10.924910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:10.926025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:10.927198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 553/1101] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:10.932019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9e5c9-ae0f-4329-a664-507b5338deca None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:10.994367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:11.027212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9e5c9-ae0f-4329-a664-507b5338deca None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.059094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a59c3-0946-4f17-a213-2da56f81b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.059751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a59c3-0946-4f17-a213-2da56f81b71b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.060037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a59c3-0946-4f17-a213-2da56f81b71b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.060329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a59c3-0946-4f17-a213-2da56f81b71b None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.061062 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a59c3-0946-4f17-a213-2da56f81b71b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:11.061372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a59c3-0946-4f17-a213-2da56f81b71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.062769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a59c3-0946-4f17-a213-2da56f81b71b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.071538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 549/1102] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:11.077261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf65e7-349e-4351-b86c-dbebb8dafd8d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.160367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:11.180680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf65e7-349e-4351-b86c-dbebb8dafd8d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.214933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e55c0d-4b61-47d5-8617-1b34f1bcf8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.215786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e55c0d-4b61-47d5-8617-1b34f1bcf8fe None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.216069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e55c0d-4b61-47d5-8617-1b34f1bcf8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.216344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e55c0d-4b61-47d5-8617-1b34f1bcf8fe None admin] PATH_INFO: `/v3/users/93c1aa02d83a43ea872ea990b346a92b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.217492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e55c0d-4b61-47d5-8617-1b34f1bcf8fe None admin] RBAC: Authorizing `identity:get_user(user_id=93c1aa02d83a43ea872ea990b346a92b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.218936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e55c0d-4b61-47d5-8617-1b34f1bcf8fe None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.220530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 554/1103] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/users/93c1aa02d83a43ea872ea990b346a92b => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:11.226454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a59c3-0946-4f17-a213-2da56f81b71b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.322730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a59c3-0946-4f17-a213-2da56f81b71b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.347939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:11.355367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b869b-2508-46f2-a92d-2fdd9520e30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.356353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b869b-2508-46f2-a92d-2fdd9520e30b None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.356353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b869b-2508-46f2-a92d-2fdd9520e30b None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.356545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b869b-2508-46f2-a92d-2fdd9520e30b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.420582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b869b-2508-46f2-a92d-2fdd9520e30b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.421966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b869b-2508-46f2-a92d-2fdd9520e30b None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.515952 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 550/1104] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:34:11.521837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e55c0d-4b61-47d5-8617-1b34f1bcf8fe None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.617001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e55c0d-4b61-47d5-8617-1b34f1bcf8fe None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.649306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c7a9-3aa0-4a82-9577-2a9f75f8f3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.650168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c7a9-3aa0-4a82-9577-2a9f75f8f3f3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.650454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c7a9-3aa0-4a82-9577-2a9f75f8f3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.650729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c7a9-3aa0-4a82-9577-2a9f75f8f3f3 None admin] PATH_INFO: `/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.651882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1c7a9-3aa0-4a82-9577-2a9f75f8f3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=c59be571f2d647fa97c7bb9bcdea6fae)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.653292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1c7a9-3aa0-4a82-9577-2a9f75f8f3f3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.655124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 555/1105] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:11.661112 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b869b-2508-46f2-a92d-2fdd9520e30b None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.688589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:11.758602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b869b-2508-46f2-a92d-2fdd9520e30b None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.791549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631bc8e-dc39-428b-adea-a1df0a83e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.792194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631bc8e-dc39-428b-adea-a1df0a83e5de None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.792475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631bc8e-dc39-428b-adea-a1df0a83e5de None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.792775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631bc8e-dc39-428b-adea-a1df0a83e5de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.793604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631bc8e-dc39-428b-adea-a1df0a83e5de None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=c59be571f2d647fa97c7bb9bcdea6fae, user.id=93c1aa02d83a43ea872ea990b346a92b) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:11.793917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631bc8e-dc39-428b-adea-a1df0a83e5de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.795364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631bc8e-dc39-428b-adea-a1df0a83e5de None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.801078 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 551/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/role_assignments?user.id=93c1aa02d83a43ea872ea990b346a92b&scope.project.id=c59be571f2d647fa97c7bb9bcdea6fae&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:13.823182 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a060f6-b930-4aee-9d91-6fb50aad5210 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:13.823749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a060f6-b930-4aee-9d91-6fb50aad5210 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:13.823749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a060f6-b930-4aee-9d91-6fb50aad5210 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:13.831660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 556/1107] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:13.831763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660803a-e654-442c-879e-6d90610a6979 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:13.831763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660803a-e654-442c-879e-6d90610a6979 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:13.831763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660803a-e654-442c-879e-6d90610a6979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:13.847810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f660803a-e654-442c-879e-6d90610a6979 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:13.848994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f660803a-e654-442c-879e-6d90610a6979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:13.914836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 552/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:13.938943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a060f6-b930-4aee-9d91-6fb50aad5210 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:13.954321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:14.038573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a060f6-b930-4aee-9d91-6fb50aad5210 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:14.071806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4346f-3776-46e2-a443-3c30a6ada0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:14.072575 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4346f-3776-46e2-a443-3c30a6ada0f3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:14.072858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4346f-3776-46e2-a443-3c30a6ada0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:14.073136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4346f-3776-46e2-a443-3c30a6ada0f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:14.074355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4346f-3776-46e2-a443-3c30a6ada0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:14.075727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4346f-3776-46e2-a443-3c30a6ada0f3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:14.077288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 557/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:14.082956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660803a-e654-442c-879e-6d90610a6979 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:14.106662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:14.177997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660803a-e654-442c-879e-6d90610a6979 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:14.210683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bb00c-1e3f-4262-a91c-a62104c2083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:14.211334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bb00c-1e3f-4262-a91c-a62104c2083d None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:14.211617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bb00c-1e3f-4262-a91c-a62104c2083d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:14.211894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bb00c-1e3f-4262-a91c-a62104c2083d None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:14.212595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bb00c-1e3f-4262-a91c-a62104c2083d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:14.214045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bb00c-1e3f-4262-a91c-a62104c2083d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:14.277967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 553/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:34:14 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:16.300648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78242330-2248-4d37-8be7-915496839306 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:16.301225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78242330-2248-4d37-8be7-915496839306 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:16.301335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78242330-2248-4d37-8be7-915496839306 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:16.302737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 558/1111] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:16.308331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3af0d-19e1-4a0f-9d4a-2ba51f7c3f53 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:16.308753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3af0d-19e1-4a0f-9d4a-2ba51f7c3f53 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:16.308905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3af0d-19e1-4a0f-9d4a-2ba51f7c3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:16.325233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3ea3af0d-19e1-4a0f-9d4a-2ba51f7c3f53 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:16.326512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3ea3af0d-19e1-4a0f-9d4a-2ba51f7c3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:16.392168 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 554/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:16.415892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78242330-2248-4d37-8be7-915496839306 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:16.496774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:16.515262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78242330-2248-4d37-8be7-915496839306 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:16.548242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd995f6-1d2d-4499-b28a-408ddef00a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:16.549085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd995f6-1d2d-4499-b28a-408ddef00a48 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:16.549371 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd995f6-1d2d-4499-b28a-408ddef00a48 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:16.549651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd995f6-1d2d-4499-b28a-408ddef00a48 None admin] PATH_INFO: `/v3/roles/a49601657f8b4e909b0a9b2adb444573` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:16.551268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd995f6-1d2d-4499-b28a-408ddef00a48 None admin] RBAC: Authorizing `identity:get_role(role_id=a49601657f8b4e909b0a9b2adb444573)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:16.552583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd995f6-1d2d-4499-b28a-408ddef00a48 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:16.553983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 559/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:16 2022] GET /identity/v3/roles/a49601657f8b4e909b0a9b2adb444573 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:16.559630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3af0d-19e1-4a0f-9d4a-2ba51f7c3f53 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:16.570051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:16.655347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3af0d-19e1-4a0f-9d4a-2ba51f7c3f53 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:16.688161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293da190-7d10-462b-b777-c747bb1e4d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:16.689018 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293da190-7d10-462b-b777-c747bb1e4d54 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:16.689305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293da190-7d10-462b-b777-c747bb1e4d54 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:16.689584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293da190-7d10-462b-b777-c747bb1e4d54 None admin] PATH_INFO: `/v3/users/d3116c23744b457195dc9cc9bcbb28ca` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:16.702856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293da190-7d10-462b-b777-c747bb1e4d54 None admin] RBAC: Authorizing `identity:get_user(user_id=d3116c23744b457195dc9cc9bcbb28ca)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:16.704287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293da190-7d10-462b-b777-c747bb1e4d54 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:16.705903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 555/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:16 2022] GET /identity/v3/users/d3116c23744b457195dc9cc9bcbb28ca => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:16.711439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd995f6-1d2d-4499-b28a-408ddef00a48 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:16.806990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd995f6-1d2d-4499-b28a-408ddef00a48 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:16.840228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d69638-47e8-4cf5-a64b-705ea859c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:16.840856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d69638-47e8-4cf5-a64b-705ea859c7ef None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:16.841139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d69638-47e8-4cf5-a64b-705ea859c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:16.841415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d69638-47e8-4cf5-a64b-705ea859c7ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:16.859284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:16.907860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d69638-47e8-4cf5-a64b-705ea859c7ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:16.909309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d69638-47e8-4cf5-a64b-705ea859c7ef None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:17.005607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 560/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:34:17.011536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293da190-7d10-462b-b777-c747bb1e4d54 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:17.084394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:17.117222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293da190-7d10-462b-b777-c747bb1e4d54 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:17.148626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34650dc-eeee-43c6-bfc8-de1d70c17747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:17.149483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34650dc-eeee-43c6-bfc8-de1d70c17747 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:17.149768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34650dc-eeee-43c6-bfc8-de1d70c17747 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:17.150075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34650dc-eeee-43c6-bfc8-de1d70c17747 None admin] PATH_INFO: `/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:17.151237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34650dc-eeee-43c6-bfc8-de1d70c17747 None admin] RBAC: Authorizing `identity:get_project(project_id=c59be571f2d647fa97c7bb9bcdea6fae)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:17.152653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34650dc-eeee-43c6-bfc8-de1d70c17747 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:17.154358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 556/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:17 2022] GET /identity/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:17.160419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d69638-47e8-4cf5-a64b-705ea859c7ef None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:17.216839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:17.265522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d69638-47e8-4cf5-a64b-705ea859c7ef None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:17.298289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9bf70-1785-4703-aa41-0c285e0489cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:17.298933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9bf70-1785-4703-aa41-0c285e0489cb None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:17.299220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9bf70-1785-4703-aa41-0c285e0489cb None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:17.299498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9bf70-1785-4703-aa41-0c285e0489cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:17.300326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9bf70-1785-4703-aa41-0c285e0489cb None admin] RBAC: Adding query filter params (role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=c59be571f2d647fa97c7bb9bcdea6fae, user.id=d3116c23744b457195dc9cc9bcbb28ca) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:17.300645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9bf70-1785-4703-aa41-0c285e0489cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:17.302096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9bf70-1785-4703-aa41-0c285e0489cb None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:17.308008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 561/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:34:17 2022] GET /identity/v3/role_assignments?user.id=d3116c23744b457195dc9cc9bcbb28ca&scope.project.id=c59be571f2d647fa97c7bb9bcdea6fae&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:19.298652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375803c-8beb-4962-91f6-473471d11c20 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:19.299177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375803c-8beb-4962-91f6-473471d11c20 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:19.299278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375803c-8beb-4962-91f6-473471d11c20 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:19.300593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 557/1118] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:19.305844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e325-deba-40ff-8292-9d5b97c040e5 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:19.306296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e325-deba-40ff-8292-9d5b97c040e5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:19.306443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e325-deba-40ff-8292-9d5b97c040e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:19.323493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3f00e325-deba-40ff-8292-9d5b97c040e5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:19.324671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3f00e325-deba-40ff-8292-9d5b97c040e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:19.388869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 562/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:19.418654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375803c-8beb-4962-91f6-473471d11c20 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:19.516743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375803c-8beb-4962-91f6-473471d11c20 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:19.549069 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d685d8-1172-4f20-8151-033d9fb73aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:19.549856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d685d8-1172-4f20-8151-033d9fb73aad None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:19.550171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d685d8-1172-4f20-8151-033d9fb73aad None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:19.550451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d685d8-1172-4f20-8151-033d9fb73aad None admin] PATH_INFO: `/v3/roles/a49601657f8b4e909b0a9b2adb444573` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:19.551910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d685d8-1172-4f20-8151-033d9fb73aad None admin] RBAC: Authorizing `identity:get_role(role_id=a49601657f8b4e909b0a9b2adb444573)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:19.553333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d685d8-1172-4f20-8151-033d9fb73aad None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:19.554715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 558/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:19 2022] GET /identity/v3/roles/a49601657f8b4e909b0a9b2adb444573 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:19.560437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e325-deba-40ff-8292-9d5b97c040e5 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:19.606898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:19.659506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e325-deba-40ff-8292-9d5b97c040e5 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:19.692450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869ce94-31ad-4ee1-897d-bc65850dc548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:19.693891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869ce94-31ad-4ee1-897d-bc65850dc548 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:19.694221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869ce94-31ad-4ee1-897d-bc65850dc548 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:19.694502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869ce94-31ad-4ee1-897d-bc65850dc548 None admin] PATH_INFO: `/v3/users/d3116c23744b457195dc9cc9bcbb28ca` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:19.695684 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869ce94-31ad-4ee1-897d-bc65850dc548 None admin] RBAC: Authorizing `identity:get_user(user_id=d3116c23744b457195dc9cc9bcbb28ca)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:19.697133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869ce94-31ad-4ee1-897d-bc65850dc548 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:19.698787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 563/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:19 2022] GET /identity/v3/users/d3116c23744b457195dc9cc9bcbb28ca => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:19.704482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d685d8-1172-4f20-8151-033d9fb73aad None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:19.707314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:19.803729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d685d8-1172-4f20-8151-033d9fb73aad None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:19.836766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e9550-b22e-4b13-85f6-27c9279be5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:19.837617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e9550-b22e-4b13-85f6-27c9279be5a4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:19.837903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e9550-b22e-4b13-85f6-27c9279be5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:19.838216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e9550-b22e-4b13-85f6-27c9279be5a4 None admin] PATH_INFO: `/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:19.839390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e9550-b22e-4b13-85f6-27c9279be5a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c59be571f2d647fa97c7bb9bcdea6fae)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:19.840820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e9550-b22e-4b13-85f6-27c9279be5a4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:19.842537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 559/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:19 2022] GET /identity/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:19.849095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869ce94-31ad-4ee1-897d-bc65850dc548 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:19.948530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869ce94-31ad-4ee1-897d-bc65850dc548 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:19.961433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:19.982637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68356112-de9e-4f32-bea1-ab2ccebef8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:19.983522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68356112-de9e-4f32-bea1-ab2ccebef8d5 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:19.983809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68356112-de9e-4f32-bea1-ab2ccebef8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:19.984092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68356112-de9e-4f32-bea1-ab2ccebef8d5 None admin] PATH_INFO: `/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae/users/d3116c23744b457195dc9cc9bcbb28ca/roles/a49601657f8b4e909b0a9b2adb444573` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:19.986676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68356112-de9e-4f32-bea1-ab2ccebef8d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c59be571f2d647fa97c7bb9bcdea6fae, user_id=d3116c23744b457195dc9cc9bcbb28ca, role_id=a49601657f8b4e909b0a9b2adb444573)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:19.988112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68356112-de9e-4f32-bea1-ab2ccebef8d5 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:20.063036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 564/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:34:19 2022] PUT /identity/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae/users/d3116c23744b457195dc9cc9bcbb28ca/roles/a49601657f8b4e909b0a9b2adb444573 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:22.046710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefff42-02f1-41fc-9eb2-dda908df58ae None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:22.047253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefff42-02f1-41fc-9eb2-dda908df58ae None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:22.047253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefff42-02f1-41fc-9eb2-dda908df58ae None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:22.048636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 560/1124] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:22.053819 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38653e98-3ee1-4bbd-83e5-3ba3e15738df None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:22.054269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38653e98-3ee1-4bbd-83e5-3ba3e15738df None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:22.054423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38653e98-3ee1-4bbd-83e5-3ba3e15738df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:22.071326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-38653e98-3ee1-4bbd-83e5-3ba3e15738df None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:22.072495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-38653e98-3ee1-4bbd-83e5-3ba3e15738df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:22.137261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 565/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:22.161292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefff42-02f1-41fc-9eb2-dda908df58ae None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:22.229711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:22.260215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefff42-02f1-41fc-9eb2-dda908df58ae None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:22.292506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7bbb-dbc2-4d88-8428-eed8a3148a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:22.293347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7bbb-dbc2-4d88-8428-eed8a3148a77 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:22.293635 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7bbb-dbc2-4d88-8428-eed8a3148a77 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:22.293915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7bbb-dbc2-4d88-8428-eed8a3148a77 None admin] PATH_INFO: `/v3/roles/a49601657f8b4e909b0a9b2adb444573` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:22.295401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f7bbb-dbc2-4d88-8428-eed8a3148a77 None admin] RBAC: Authorizing `identity:get_role(role_id=a49601657f8b4e909b0a9b2adb444573)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:22.296777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f7bbb-dbc2-4d88-8428-eed8a3148a77 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:22.298141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 561/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:22 2022] GET /identity/v3/roles/a49601657f8b4e909b0a9b2adb444573 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:22.303715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38653e98-3ee1-4bbd-83e5-3ba3e15738df None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:22.398360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38653e98-3ee1-4bbd-83e5-3ba3e15738df None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:22.399834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:22.431391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a3150-4b1d-46ab-8239-4965dcf32821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:22.432184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a3150-4b1d-46ab-8239-4965dcf32821 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:22.432467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a3150-4b1d-46ab-8239-4965dcf32821 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:22.432743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a3150-4b1d-46ab-8239-4965dcf32821 None admin] PATH_INFO: `/v3/users/d3116c23744b457195dc9cc9bcbb28ca` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:22.433904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a3150-4b1d-46ab-8239-4965dcf32821 None admin] RBAC: Authorizing `identity:get_user(user_id=d3116c23744b457195dc9cc9bcbb28ca)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:22.435359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a3150-4b1d-46ab-8239-4965dcf32821 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:22.436941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 566/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:22 2022] GET /identity/v3/users/d3116c23744b457195dc9cc9bcbb28ca => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:22.442566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7bbb-dbc2-4d88-8428-eed8a3148a77 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:22.539215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7bbb-dbc2-4d88-8428-eed8a3148a77 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:22.571210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d8fbe-3501-4fac-935f-9c3a37e99930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:22.571839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d8fbe-3501-4fac-935f-9c3a37e99930 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:22.572121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d8fbe-3501-4fac-935f-9c3a37e99930 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:22.572397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d8fbe-3501-4fac-935f-9c3a37e99930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:22.579954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:22.637669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d8fbe-3501-4fac-935f-9c3a37e99930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:22.639196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d8fbe-3501-4fac-935f-9c3a37e99930 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:22.732932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 562/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:34:22.738920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a3150-4b1d-46ab-8239-4965dcf32821 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:22.835428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a3150-4b1d-46ab-8239-4965dcf32821 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:22.868224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a86778-45cf-4c7e-b68b-758589b1bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:22.869064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a86778-45cf-4c7e-b68b-758589b1bb54 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:22.869352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a86778-45cf-4c7e-b68b-758589b1bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:22.869630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a86778-45cf-4c7e-b68b-758589b1bb54 None admin] PATH_INFO: `/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:22.870822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a86778-45cf-4c7e-b68b-758589b1bb54 None admin] RBAC: Authorizing `identity:get_project(project_id=c59be571f2d647fa97c7bb9bcdea6fae)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:22.872256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a86778-45cf-4c7e-b68b-758589b1bb54 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:22.873894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 567/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:22 2022] GET /identity/v3/projects/c59be571f2d647fa97c7bb9bcdea6fae => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:22.879816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d8fbe-3501-4fac-935f-9c3a37e99930 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:22.918563 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:22.976973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d8fbe-3501-4fac-935f-9c3a37e99930 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:23.010109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbcdfc-b8f3-42f1-82ff-190cb419436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:23.010663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbcdfc-b8f3-42f1-82ff-190cb419436e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:23.010947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbcdfc-b8f3-42f1-82ff-190cb419436e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:23.011223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbcdfc-b8f3-42f1-82ff-190cb419436e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:23.012044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbcdfc-b8f3-42f1-82ff-190cb419436e None admin] RBAC: Adding query filter params (role.id=a49601657f8b4e909b0a9b2adb444573, scope.project.id=c59be571f2d647fa97c7bb9bcdea6fae, user.id=d3116c23744b457195dc9cc9bcbb28ca) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:23.012361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbcdfc-b8f3-42f1-82ff-190cb419436e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:23.013777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbcdfc-b8f3-42f1-82ff-190cb419436e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:23.019456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 563/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:34:22 2022] GET /identity/v3/role_assignments?user.id=d3116c23744b457195dc9cc9bcbb28ca&scope.project.id=c59be571f2d647fa97c7bb9bcdea6fae&role.id=a49601657f8b4e909b0a9b2adb444573 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:25.029361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004b0df-908c-476c-812d-d4118ffae4f2 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:25.029904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004b0df-908c-476c-812d-d4118ffae4f2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:25.029904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004b0df-908c-476c-812d-d4118ffae4f2 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:25.031299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 568/1131] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:25.036491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62040580-9d6c-4b53-8683-37d30ef06939 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:25.037508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62040580-9d6c-4b53-8683-37d30ef06939 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:25.037680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62040580-9d6c-4b53-8683-37d30ef06939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:25.053866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-62040580-9d6c-4b53-8683-37d30ef06939 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:25.055060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-62040580-9d6c-4b53-8683-37d30ef06939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:25.118487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 564/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:25.141630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004b0df-908c-476c-812d-d4118ffae4f2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:25.182730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:25.242280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004b0df-908c-476c-812d-d4118ffae4f2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:25.275811 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdd7fe-a67e-43bf-be1e-80bcb23e1bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:25.276596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdd7fe-a67e-43bf-be1e-80bcb23e1bc3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:25.276885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdd7fe-a67e-43bf-be1e-80bcb23e1bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:25.277165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdd7fe-a67e-43bf-be1e-80bcb23e1bc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:25.278426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdd7fe-a67e-43bf-be1e-80bcb23e1bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:25.279818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdd7fe-a67e-43bf-be1e-80bcb23e1bc3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:25.281409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 569/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:25.287306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62040580-9d6c-4b53-8683-37d30ef06939 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:25.316378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:25.383590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62040580-9d6c-4b53-8683-37d30ef06939 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:25.417212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfbb7a-a636-4309-a63c-b31e4e737f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:25.418222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfbb7a-a636-4309-a63c-b31e4e737f14 None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:25.418663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfbb7a-a636-4309-a63c-b31e4e737f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:25.419086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfbb7a-a636-4309-a63c-b31e4e737f14 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:25.420198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfbb7a-a636-4309-a63c-b31e4e737f14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:25.422500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfbb7a-a636-4309-a63c-b31e4e737f14 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:25.538801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 565/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:34:25 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:34:27.590689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd097c5-38af-4b3a-87a5-42bf8639e8b6 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:27.591240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd097c5-38af-4b3a-87a5-42bf8639e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:27.591240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd097c5-38af-4b3a-87a5-42bf8639e8b6 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:27.592609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 570/1135] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:27.597933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cea9-a9d3-440f-86f5-c84cc1cdc02e None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:27.598338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cea9-a9d3-440f-86f5-c84cc1cdc02e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:27.598541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cea9-a9d3-440f-86f5-c84cc1cdc02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:27.614962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1ba8cea9-a9d3-440f-86f5-c84cc1cdc02e None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:27.616141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1ba8cea9-a9d3-440f-86f5-c84cc1cdc02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:27.685276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 566/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:27.711199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd097c5-38af-4b3a-87a5-42bf8639e8b6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:27.815296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd097c5-38af-4b3a-87a5-42bf8639e8b6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:27.823464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:27.850455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54c52e-5e9f-442b-993c-2cfefd6c2a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:27.851185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54c52e-5e9f-442b-993c-2cfefd6c2a10 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:27.851473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54c52e-5e9f-442b-993c-2cfefd6c2a10 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:27.851752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54c52e-5e9f-442b-993c-2cfefd6c2a10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:27.852943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54c52e-5e9f-442b-993c-2cfefd6c2a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:27.854423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54c52e-5e9f-442b-993c-2cfefd6c2a10 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:27.856035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 571/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:27.861793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cea9-a9d3-440f-86f5-c84cc1cdc02e None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:27.878988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:27.966864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cea9-a9d3-440f-86f5-c84cc1cdc02e None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:27.999488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec540f6-1165-4cac-be2d-04d397d0b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.000157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec540f6-1165-4cac-be2d-04d397d0b56f None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.000441 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec540f6-1165-4cac-be2d-04d397d0b56f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.000715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec540f6-1165-4cac-be2d-04d397d0b56f None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.001434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec540f6-1165-4cac-be2d-04d397d0b56f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.002891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec540f6-1165-4cac-be2d-04d397d0b56f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.094189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 567/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:34:27 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:30.137110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362b4e-03f0-43f0-9548-16cdbb4ef5df None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.137627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362b4e-03f0-43f0-9548-16cdbb4ef5df None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.137746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362b4e-03f0-43f0-9548-16cdbb4ef5df None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.139071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 572/1139] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:30.144270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22744a-5994-4329-9670-a6cda9b6162b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.144673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22744a-5994-4329-9670-a6cda9b6162b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.144763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22744a-5994-4329-9670-a6cda9b6162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.161063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ab22744a-5994-4329-9670-a6cda9b6162b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:30.162337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ab22744a-5994-4329-9670-a6cda9b6162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:30.223287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:30.227744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 568/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:30.251484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362b4e-03f0-43f0-9548-16cdbb4ef5df None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.351109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362b4e-03f0-43f0-9548-16cdbb4ef5df None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.384791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff9d63-784c-49e6-bfde-7d3b773a50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.385564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff9d63-784c-49e6-bfde-7d3b773a50b9 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.385852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff9d63-784c-49e6-bfde-7d3b773a50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.386160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff9d63-784c-49e6-bfde-7d3b773a50b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.396023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff9d63-784c-49e6-bfde-7d3b773a50b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-12ff9d63-784c-49e6-bfde-7d3b773a50b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:30.403541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:30.404703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:30.405834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 573/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:30.410693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22744a-5994-4329-9670-a6cda9b6162b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.506174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22744a-5994-4329-9670-a6cda9b6162b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.539080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081c03a-e0cf-4734-a852-54108ed14e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.539737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081c03a-e0cf-4734-a852-54108ed14e8f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.540027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081c03a-e0cf-4734-a852-54108ed14e8f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.540308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081c03a-e0cf-4734-a852-54108ed14e8f None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.541056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081c03a-e0cf-4734-a852-54108ed14e8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:30.541366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081c03a-e0cf-4734-a852-54108ed14e8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.542757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081c03a-e0cf-4734-a852-54108ed14e8f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.550676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 569/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:30.556212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff9d63-784c-49e6-bfde-7d3b773a50b9 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.591645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:30.655965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff9d63-784c-49e6-bfde-7d3b773a50b9 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.687933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c659647-5e0d-4e69-b38c-3c06a04ef36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.688784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c659647-5e0d-4e69-b38c-3c06a04ef36a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.689070 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c659647-5e0d-4e69-b38c-3c06a04ef36a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.689349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c659647-5e0d-4e69-b38c-3c06a04ef36a None admin] PATH_INFO: `/v3/users/749be2b0cdd34be78c04c3fa8eb55889` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.702842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c659647-5e0d-4e69-b38c-3c06a04ef36a None admin] RBAC: Authorizing `identity:get_user(user_id=749be2b0cdd34be78c04c3fa8eb55889)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.704294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c659647-5e0d-4e69-b38c-3c06a04ef36a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.705923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 574/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:30 2022] GET /identity/v3/users/749be2b0cdd34be78c04c3fa8eb55889 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:30.712060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081c03a-e0cf-4734-a852-54108ed14e8f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.771409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:30.808137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081c03a-e0cf-4734-a852-54108ed14e8f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.840576 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625a21c-348b-4237-94b7-bebffc742493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.841212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625a21c-348b-4237-94b7-bebffc742493 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.841500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625a21c-348b-4237-94b7-bebffc742493 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.841776 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625a21c-348b-4237-94b7-bebffc742493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.906197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625a21c-348b-4237-94b7-bebffc742493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.907591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625a21c-348b-4237-94b7-bebffc742493 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.964311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:31.001875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 570/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:34:31.008270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c659647-5e0d-4e69-b38c-3c06a04ef36a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:31.097323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:31.105801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c659647-5e0d-4e69-b38c-3c06a04ef36a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:31.139804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134948cb-368c-4283-b233-6f2021481fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:31.140657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134948cb-368c-4283-b233-6f2021481fd9 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:31.140942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134948cb-368c-4283-b233-6f2021481fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:31.141220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134948cb-368c-4283-b233-6f2021481fd9 None admin] PATH_INFO: `/v3/projects/237eff1b55854e1fa0bb16265fa2269a` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:31.142423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134948cb-368c-4283-b233-6f2021481fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=237eff1b55854e1fa0bb16265fa2269a)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:31.143858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134948cb-368c-4283-b233-6f2021481fd9 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:31.145524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 575/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:31 2022] GET /identity/v3/projects/237eff1b55854e1fa0bb16265fa2269a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:31.151482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625a21c-348b-4237-94b7-bebffc742493 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:31.247499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625a21c-348b-4237-94b7-bebffc742493 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:31.279302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75134f-d697-4cfe-98fb-50057e22a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:31.279938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75134f-d697-4cfe-98fb-50057e22a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:31.280222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75134f-d697-4cfe-98fb-50057e22a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:31.280501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75134f-d697-4cfe-98fb-50057e22a0f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:31.281329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75134f-d697-4cfe-98fb-50057e22a0f1 None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=237eff1b55854e1fa0bb16265fa2269a, user.id=749be2b0cdd34be78c04c3fa8eb55889) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:31.281643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75134f-d697-4cfe-98fb-50057e22a0f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:31.283095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75134f-d697-4cfe-98fb-50057e22a0f1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:31.288864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 571/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:34:31 2022] GET /identity/v3/role_assignments?user.id=749be2b0cdd34be78c04c3fa8eb55889&scope.project.id=237eff1b55854e1fa0bb16265fa2269a&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:33.260386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e21db-6ad2-4432-9aae-92c0b81047dc None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:33.260886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e21db-6ad2-4432-9aae-92c0b81047dc None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:33.260886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e21db-6ad2-4432-9aae-92c0b81047dc None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:33.262245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 576/1147] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:33.267447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287f964-caf2-47e2-b7ff-3a186a33b284 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:33.267887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287f964-caf2-47e2-b7ff-3a186a33b284 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:33.268007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287f964-caf2-47e2-b7ff-3a186a33b284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:33.284161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3287f964-caf2-47e2-b7ff-3a186a33b284 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:33.285323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3287f964-caf2-47e2-b7ff-3a186a33b284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:33.305198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:33.349958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 572/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:33.372378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e21db-6ad2-4432-9aae-92c0b81047dc None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:33.471073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e21db-6ad2-4432-9aae-92c0b81047dc None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:33.504358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34378557-26dc-499a-afec-5a9b4e2c91a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:33.505157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34378557-26dc-499a-afec-5a9b4e2c91a4 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:33.505444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34378557-26dc-499a-afec-5a9b4e2c91a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:33.505722 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34378557-26dc-499a-afec-5a9b4e2c91a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:33.515603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34378557-26dc-499a-afec-5a9b4e2c91a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-34378557-26dc-499a-afec-5a9b4e2c91a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:33.523196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:33.524270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:33.525449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 577/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:33.530511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287f964-caf2-47e2-b7ff-3a186a33b284 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:33.625490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287f964-caf2-47e2-b7ff-3a186a33b284 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:33.657197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eef74-4b32-451b-8d77-dd80fe1d187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:33.657848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eef74-4b32-451b-8d77-dd80fe1d187e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:33.658161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eef74-4b32-451b-8d77-dd80fe1d187e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:33.658441 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eef74-4b32-451b-8d77-dd80fe1d187e None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:33.659187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216eef74-4b32-451b-8d77-dd80fe1d187e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:33.659499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216eef74-4b32-451b-8d77-dd80fe1d187e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:33.660866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216eef74-4b32-451b-8d77-dd80fe1d187e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:33.669318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 573/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:33.674959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34378557-26dc-499a-afec-5a9b4e2c91a4 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:33.697698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:33.774352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34378557-26dc-499a-afec-5a9b4e2c91a4 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:33.807662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfda00-5daf-4cf3-b8de-6f3e8f9872ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:33.808522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfda00-5daf-4cf3-b8de-6f3e8f9872ab None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:33.808811 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfda00-5daf-4cf3-b8de-6f3e8f9872ab None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:33.809092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfda00-5daf-4cf3-b8de-6f3e8f9872ab None admin] PATH_INFO: `/v3/users/749be2b0cdd34be78c04c3fa8eb55889` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:33.810319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfda00-5daf-4cf3-b8de-6f3e8f9872ab None admin] RBAC: Authorizing `identity:get_user(user_id=749be2b0cdd34be78c04c3fa8eb55889)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:33.811759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfda00-5daf-4cf3-b8de-6f3e8f9872ab None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:33.813373 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 578/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:33 2022] GET /identity/v3/users/749be2b0cdd34be78c04c3fa8eb55889 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:33.819293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eef74-4b32-451b-8d77-dd80fe1d187e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:33.838237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:33.917918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eef74-4b32-451b-8d77-dd80fe1d187e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:33.949437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ff35-525c-4f16-99bf-2b3a3f2ef37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:33.950320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ff35-525c-4f16-99bf-2b3a3f2ef37e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:33.950605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ff35-525c-4f16-99bf-2b3a3f2ef37e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:33.950879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ff35-525c-4f16-99bf-2b3a3f2ef37e None admin] PATH_INFO: `/v3/projects/237eff1b55854e1fa0bb16265fa2269a` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:33.952049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ff35-525c-4f16-99bf-2b3a3f2ef37e None admin] RBAC: Authorizing `identity:get_project(project_id=237eff1b55854e1fa0bb16265fa2269a)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:33.953466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ff35-525c-4f16-99bf-2b3a3f2ef37e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:33.955178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 574/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:33 2022] GET /identity/v3/projects/237eff1b55854e1fa0bb16265fa2269a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:33.961584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfda00-5daf-4cf3-b8de-6f3e8f9872ab None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:34.048261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:34.059750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfda00-5daf-4cf3-b8de-6f3e8f9872ab None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:34.091938 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b16e92-e11a-4f32-8c00-a5b6d01bfc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:34.092813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b16e92-e11a-4f32-8c00-a5b6d01bfc35 None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:34.093102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b16e92-e11a-4f32-8c00-a5b6d01bfc35 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:34.093382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b16e92-e11a-4f32-8c00-a5b6d01bfc35 None admin] PATH_INFO: `/v3/projects/237eff1b55854e1fa0bb16265fa2269a/users/749be2b0cdd34be78c04c3fa8eb55889/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:34.095361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b16e92-e11a-4f32-8c00-a5b6d01bfc35 None admin] RBAC: Authorizing `identity:create_grant(project_id=237eff1b55854e1fa0bb16265fa2269a, user_id=749be2b0cdd34be78c04c3fa8eb55889, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:34.097058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b16e92-e11a-4f32-8c00-a5b6d01bfc35 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:34.207735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 579/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:34:33 2022] PUT /identity/v3/projects/237eff1b55854e1fa0bb16265fa2269a/users/749be2b0cdd34be78c04c3fa8eb55889/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:36.199193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e32347-0dc8-44a1-b368-b75f85c944d8 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:36.199705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e32347-0dc8-44a1-b368-b75f85c944d8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:36.199705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e32347-0dc8-44a1-b368-b75f85c944d8 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:36.201059 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 575/1154] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:36.206510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0fef5-b60a-40a8-b190-5e1947866917 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:36.206921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0fef5-b60a-40a8-b190-5e1947866917 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:36.207083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0fef5-b60a-40a8-b190-5e1947866917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:36.223849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a6a0fef5-b60a-40a8-b190-5e1947866917 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:36.225306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a6a0fef5-b60a-40a8-b190-5e1947866917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:36.290758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 580/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:36.314398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e32347-0dc8-44a1-b368-b75f85c944d8 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:36.398606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:36.414104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e32347-0dc8-44a1-b368-b75f85c944d8 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:36.446147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52792da5-65d7-4d00-bcb7-a2b2dcbf6e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:36.446923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52792da5-65d7-4d00-bcb7-a2b2dcbf6e82 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:36.447211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52792da5-65d7-4d00-bcb7-a2b2dcbf6e82 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:36.447491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52792da5-65d7-4d00-bcb7-a2b2dcbf6e82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:36.457434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52792da5-65d7-4d00-bcb7-a2b2dcbf6e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-52792da5-65d7-4d00-bcb7-a2b2dcbf6e82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:36.465503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:36.466613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:36.467669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 576/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:36.473020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0fef5-b60a-40a8-b190-5e1947866917 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:36.548304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:36.569296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0fef5-b60a-40a8-b190-5e1947866917 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:36.603056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb3ec-d0ab-403d-b877-413e1d07257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:36.603711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb3ec-d0ab-403d-b877-413e1d07257f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:36.604001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb3ec-d0ab-403d-b877-413e1d07257f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:36.604311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb3ec-d0ab-403d-b877-413e1d07257f None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:36.605055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb3ec-d0ab-403d-b877-413e1d07257f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:36.605367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb3ec-d0ab-403d-b877-413e1d07257f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:36.606762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb3ec-d0ab-403d-b877-413e1d07257f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:36.614594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 581/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:36.620268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52792da5-65d7-4d00-bcb7-a2b2dcbf6e82 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:36.717002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52792da5-65d7-4d00-bcb7-a2b2dcbf6e82 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:36.748524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92692d08-5049-44c2-8f1b-7e35d99a1517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:36.749375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692d08-5049-44c2-8f1b-7e35d99a1517 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:36.749658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692d08-5049-44c2-8f1b-7e35d99a1517 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:36.749933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692d08-5049-44c2-8f1b-7e35d99a1517 None admin] PATH_INFO: `/v3/users/749be2b0cdd34be78c04c3fa8eb55889` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:36.751120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92692d08-5049-44c2-8f1b-7e35d99a1517 None admin] RBAC: Authorizing `identity:get_user(user_id=749be2b0cdd34be78c04c3fa8eb55889)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:36.752543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92692d08-5049-44c2-8f1b-7e35d99a1517 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:36.754168 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 577/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:36 2022] GET /identity/v3/users/749be2b0cdd34be78c04c3fa8eb55889 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:36.760201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb3ec-d0ab-403d-b877-413e1d07257f None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:36.856715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb3ec-d0ab-403d-b877-413e1d07257f None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:36.889122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45591da2-7212-4e61-acd0-31016e0045ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:36.889760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45591da2-7212-4e61-acd0-31016e0045ec None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:36.890571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45591da2-7212-4e61-acd0-31016e0045ec None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:36.890861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45591da2-7212-4e61-acd0-31016e0045ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:36.901656 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:36.957101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45591da2-7212-4e61-acd0-31016e0045ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:36.958637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45591da2-7212-4e61-acd0-31016e0045ec None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:37.053208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 582/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:34:37.059205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92692d08-5049-44c2-8f1b-7e35d99a1517 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:37.075482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:37.154812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92692d08-5049-44c2-8f1b-7e35d99a1517 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:37.186716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4101288-46b5-45a6-8735-d94548505021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:37.187565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4101288-46b5-45a6-8735-d94548505021 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:37.187850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4101288-46b5-45a6-8735-d94548505021 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:37.188128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4101288-46b5-45a6-8735-d94548505021 None admin] PATH_INFO: `/v3/projects/237eff1b55854e1fa0bb16265fa2269a` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:37.189288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4101288-46b5-45a6-8735-d94548505021 None admin] RBAC: Authorizing `identity:get_project(project_id=237eff1b55854e1fa0bb16265fa2269a)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:37.190734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4101288-46b5-45a6-8735-d94548505021 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:37.193024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 578/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:37 2022] GET /identity/v3/projects/237eff1b55854e1fa0bb16265fa2269a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:37.199048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45591da2-7212-4e61-acd0-31016e0045ec None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:37.240240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:37.296315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45591da2-7212-4e61-acd0-31016e0045ec None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:37.329470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6fab-e1d3-4835-83cb-b4244c9ba4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:37.330096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6fab-e1d3-4835-83cb-b4244c9ba4d0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:37.330385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6fab-e1d3-4835-83cb-b4244c9ba4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:37.330664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6fab-e1d3-4835-83cb-b4244c9ba4d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:37.331490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6fab-e1d3-4835-83cb-b4244c9ba4d0 None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=237eff1b55854e1fa0bb16265fa2269a, user.id=749be2b0cdd34be78c04c3fa8eb55889) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:37.331811 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6fab-e1d3-4835-83cb-b4244c9ba4d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:37.333237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6fab-e1d3-4835-83cb-b4244c9ba4d0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:37.339443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 583/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:34:37 2022] GET /identity/v3/role_assignments?user.id=749be2b0cdd34be78c04c3fa8eb55889&scope.project.id=237eff1b55854e1fa0bb16265fa2269a&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:39.348203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb9db3-0e72-4c1d-9eae-f5ae0210a373 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:39.348745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb9db3-0e72-4c1d-9eae-f5ae0210a373 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:39.348745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb9db3-0e72-4c1d-9eae-f5ae0210a373 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:39.350173 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 579/1162] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:39.355270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe776d-a474-4d93-9a0d-ab72d63712ff None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:39.355711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe776d-a474-4d93-9a0d-ab72d63712ff None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:39.355829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe776d-a474-4d93-9a0d-ab72d63712ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:39.372730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-dbbe776d-a474-4d93-9a0d-ab72d63712ff None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:39.373894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-dbbe776d-a474-4d93-9a0d-ab72d63712ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:39.438903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 584/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:39.461566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb9db3-0e72-4c1d-9eae-f5ae0210a373 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:39.541482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:39.560071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb9db3-0e72-4c1d-9eae-f5ae0210a373 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:39.592398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6966-3d1e-4c74-9884-716526ecd5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:39.593030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6966-3d1e-4c74-9884-716526ecd5be None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:39.593317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6966-3d1e-4c74-9884-716526ecd5be None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:39.593598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6966-3d1e-4c74-9884-716526ecd5be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:39.657801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6966-3d1e-4c74-9884-716526ecd5be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:39.659216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6966-3d1e-4c74-9884-716526ecd5be None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:39.735616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:39.755630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 580/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:34:39.761517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe776d-a474-4d93-9a0d-ab72d63712ff None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:39.793979 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:39.857714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe776d-a474-4d93-9a0d-ab72d63712ff None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:39.890076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aef6c2-f3c8-47a3-b84e-7b5fc29a3fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:39.890877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aef6c2-f3c8-47a3-b84e-7b5fc29a3fda None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:39.891162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aef6c2-f3c8-47a3-b84e-7b5fc29a3fda None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:39.891438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aef6c2-f3c8-47a3-b84e-7b5fc29a3fda None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:39.898788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aef6c2-f3c8-47a3-b84e-7b5fc29a3fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:39.900219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aef6c2-f3c8-47a3-b84e-7b5fc29a3fda None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-88aef6c2-f3c8-47a3-b84e-7b5fc29a3fda None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:39.915013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:39.916097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:39.917071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 585/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:34:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:34:39.921913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6966-3d1e-4c74-9884-716526ecd5be None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:40.015603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6966-3d1e-4c74-9884-716526ecd5be None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:40.047731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36b290-fb34-41ff-97fa-e6026d511c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:40.048372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b290-fb34-41ff-97fa-e6026d511c70 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:40.048658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b290-fb34-41ff-97fa-e6026d511c70 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:40.048935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b290-fb34-41ff-97fa-e6026d511c70 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:40.049648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36b290-fb34-41ff-97fa-e6026d511c70 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:40.049971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36b290-fb34-41ff-97fa-e6026d511c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:40.051363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36b290-fb34-41ff-97fa-e6026d511c70 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:40.058284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 581/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jun 30 10:34:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:42.052213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea2a98-b3be-4954-88d5-b235e5aeb0c9 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:42.052727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea2a98-b3be-4954-88d5-b235e5aeb0c9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:42.052813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea2a98-b3be-4954-88d5-b235e5aeb0c9 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:42.054153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 586/1167] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:42.059166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ec17-cad3-48f2-a5b4-75e15477cb4a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:42.059586 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ec17-cad3-48f2-a5b4-75e15477cb4a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:42.059740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ec17-cad3-48f2-a5b4-75e15477cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:42.076618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9593ec17-cad3-48f2-a5b4-75e15477cb4a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:42.077790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9593ec17-cad3-48f2-a5b4-75e15477cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:42.119047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:42.142854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 582/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:42.165187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea2a98-b3be-4954-88d5-b235e5aeb0c9 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:42.257889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:42.265190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea2a98-b3be-4954-88d5-b235e5aeb0c9 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:42.298064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50367fbc-6a04-478c-8e0e-03d02257445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:42.298715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50367fbc-6a04-478c-8e0e-03d02257445f None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:42.299004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50367fbc-6a04-478c-8e0e-03d02257445f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:42.299287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50367fbc-6a04-478c-8e0e-03d02257445f None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:42.300035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50367fbc-6a04-478c-8e0e-03d02257445f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:42.301980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50367fbc-6a04-478c-8e0e-03d02257445f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:42.371852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 587/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Thu Jun 30 10:34:42 2022] POST /identity/v3/domains => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:44.427521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47446d-3960-4fc4-9cee-ce2265641332 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:44.428046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47446d-3960-4fc4-9cee-ce2265641332 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:44.428166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47446d-3960-4fc4-9cee-ce2265641332 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:44.429456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 583/1170] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:44.434631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c60548-23e2-46df-aecc-95f0d8688c5b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:44.434998 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c60548-23e2-46df-aecc-95f0d8688c5b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:44.435193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c60548-23e2-46df-aecc-95f0d8688c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:44.453608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-44c60548-23e2-46df-aecc-95f0d8688c5b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:44.454850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-44c60548-23e2-46df-aecc-95f0d8688c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:44.519472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 588/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:44.543808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47446d-3960-4fc4-9cee-ce2265641332 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:44.640951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47446d-3960-4fc4-9cee-ce2265641332 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:44.673601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01083df6-7f7b-4677-b81a-7882a0ddf6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:44.674477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01083df6-7f7b-4677-b81a-7882a0ddf6c5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:44.674766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01083df6-7f7b-4677-b81a-7882a0ddf6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:44.675045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01083df6-7f7b-4677-b81a-7882a0ddf6c5 None admin] PATH_INFO: `/v3/domains/28edee39d5404f538e7ae03282ffeaba` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:44.685141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01083df6-7f7b-4677-b81a-7882a0ddf6c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=28edee39d5404f538e7ae03282ffeaba)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:44.686550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01083df6-7f7b-4677-b81a-7882a0ddf6c5 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:44.688184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 584/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Jun 30 10:34:44 2022] GET /identity/v3/domains/28edee39d5404f538e7ae03282ffeaba => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:44.693750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c60548-23e2-46df-aecc-95f0d8688c5b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:44.775219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:44.789820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c60548-23e2-46df-aecc-95f0d8688c5b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:44.822667 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7da9-6988-4d98-ac1e-10619894b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:44.823314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7da9-6988-4d98-ac1e-10619894b4c5 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:44.823595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7da9-6988-4d98-ac1e-10619894b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:44.823871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7da9-6988-4d98-ac1e-10619894b4c5 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:44.824577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7da9-6988-4d98-ac1e-10619894b4c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:44.826032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7da9-6988-4d98-ac1e-10619894b4c5 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:44.903555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 589/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:34:44 2022] POST /identity/v3/projects => generated 361 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:34:46.910766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf945-1c4e-465b-83ee-184a9c0a4de3 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:46.911242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf945-1c4e-465b-83ee-184a9c0a4de3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:46.911333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf945-1c4e-465b-83ee-184a9c0a4de3 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:46.912684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 585/1174] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:46.917805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d0dc-b2e7-4f19-9a8c-e5d1969b53b9 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:46.918261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d0dc-b2e7-4f19-9a8c-e5d1969b53b9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:46.918406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d0dc-b2e7-4f19-9a8c-e5d1969b53b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:46.935501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-6af7d0dc-b2e7-4f19-9a8c-e5d1969b53b9 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:46.936669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6af7d0dc-b2e7-4f19-9a8c-e5d1969b53b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:47.001485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 590/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:47.026344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf945-1c4e-465b-83ee-184a9c0a4de3 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:47.061848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:47.123840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf945-1c4e-465b-83ee-184a9c0a4de3 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:47.157859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d977dd1-d403-4c17-8c08-ae769bd8e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:47.158678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d977dd1-d403-4c17-8c08-ae769bd8e01f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:47.158963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d977dd1-d403-4c17-8c08-ae769bd8e01f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:47.159240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d977dd1-d403-4c17-8c08-ae769bd8e01f None admin] PATH_INFO: `/v3/domains/28edee39d5404f538e7ae03282ffeaba` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:47.160939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d977dd1-d403-4c17-8c08-ae769bd8e01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=28edee39d5404f538e7ae03282ffeaba)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:47.162397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d977dd1-d403-4c17-8c08-ae769bd8e01f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:47.163987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 586/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Jun 30 10:34:47 2022] GET /identity/v3/domains/28edee39d5404f538e7ae03282ffeaba => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:47.169643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7d0dc-b2e7-4f19-9a8c-e5d1969b53b9 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:47.233673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:47.267893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7d0dc-b2e7-4f19-9a8c-e5d1969b53b9 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:47.302054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7e81d-abea-4086-9897-358944ebc81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:47.302709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7e81d-abea-4086-9897-358944ebc81b None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:47.302995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7e81d-abea-4086-9897-358944ebc81b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:47.303272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7e81d-abea-4086-9897-358944ebc81b None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:47.303979 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7e81d-abea-4086-9897-358944ebc81b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:47.305401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7e81d-abea-4086-9897-358944ebc81b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:47.404761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 591/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:34:47 2022] POST /identity/v3/users => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:49.476389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e64a16-b853-4edf-800b-28b0e7594574 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:49.476998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e64a16-b853-4edf-800b-28b0e7594574 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:49.476998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e64a16-b853-4edf-800b-28b0e7594574 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:49.478361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 587/1178] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:49.483501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71556b-4e4e-4d19-9d4b-a12bd64b6ca0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:49.483905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71556b-4e4e-4d19-9d4b-a12bd64b6ca0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:49.484056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71556b-4e4e-4d19-9d4b-a12bd64b6ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:49.500394 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-bb71556b-4e4e-4d19-9d4b-a12bd64b6ca0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:49.501561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bb71556b-4e4e-4d19-9d4b-a12bd64b6ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:49.565167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 592/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:49.589207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e64a16-b853-4edf-800b-28b0e7594574 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:49.687557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e64a16-b853-4edf-800b-28b0e7594574 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:49.689786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:49.720379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044c5d5-d5bd-442d-b7c3-be7b8b0bc966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:49.721616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044c5d5-d5bd-442d-b7c3-be7b8b0bc966 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:49.722100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044c5d5-d5bd-442d-b7c3-be7b8b0bc966 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:49.722422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044c5d5-d5bd-442d-b7c3-be7b8b0bc966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:49.732523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044c5d5-d5bd-442d-b7c3-be7b8b0bc966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-e044c5d5-d5bd-442d-b7c3-be7b8b0bc966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:49.740581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:49.741744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:49.742827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 588/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:34:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:49.747652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71556b-4e4e-4d19-9d4b-a12bd64b6ca0 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:49.798099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:49.843626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71556b-4e4e-4d19-9d4b-a12bd64b6ca0 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:49.876683 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882497c-6384-413a-a758-c256af411f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:49.877363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882497c-6384-413a-a758-c256af411f0b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:49.877646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882497c-6384-413a-a758-c256af411f0b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:49.877923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882497c-6384-413a-a758-c256af411f0b None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:49.878695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882497c-6384-413a-a758-c256af411f0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:49.879590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882497c-6384-413a-a758-c256af411f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:49.880958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882497c-6384-413a-a758-c256af411f0b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:49.888717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 593/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:34:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:49.894626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044c5d5-d5bd-442d-b7c3-be7b8b0bc966 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:49.992094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044c5d5-d5bd-442d-b7c3-be7b8b0bc966 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:50.023787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059463-92e9-49d0-bc28-883058a5f577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:50.024631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059463-92e9-49d0-bc28-883058a5f577 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:50.024913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059463-92e9-49d0-bc28-883058a5f577 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:50.025188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059463-92e9-49d0-bc28-883058a5f577 None admin] PATH_INFO: `/v3/users/81356e64865d454a95ea14a65adc048d` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:50.038307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059463-92e9-49d0-bc28-883058a5f577 None admin] RBAC: Authorizing `identity:get_user(user_id=81356e64865d454a95ea14a65adc048d)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:50.039736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059463-92e9-49d0-bc28-883058a5f577 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:50.041333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 589/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:49 2022] GET /identity/v3/users/81356e64865d454a95ea14a65adc048d => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:50.047077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882497c-6384-413a-a758-c256af411f0b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:50.147924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882497c-6384-413a-a758-c256af411f0b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:50.161517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:50.181194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556ca17-5949-46b2-91eb-8022fa168668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:50.181837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556ca17-5949-46b2-91eb-8022fa168668 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:50.182168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556ca17-5949-46b2-91eb-8022fa168668 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:50.182449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556ca17-5949-46b2-91eb-8022fa168668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:50.248824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556ca17-5949-46b2-91eb-8022fa168668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:50.250224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556ca17-5949-46b2-91eb-8022fa168668 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:50.344062 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 594/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:34:50.350837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059463-92e9-49d0-bc28-883058a5f577 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:50.374862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:50.446644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059463-92e9-49d0-bc28-883058a5f577 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:50.479821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0ba65-16f9-4a69-8b4e-3c4eff50eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:50.480671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0ba65-16f9-4a69-8b4e-3c4eff50eed4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:50.480955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0ba65-16f9-4a69-8b4e-3c4eff50eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:50.481230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0ba65-16f9-4a69-8b4e-3c4eff50eed4 None admin] PATH_INFO: `/v3/projects/b1cc3d93d0ea435c91ced02929b252f0` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:50.482425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0ba65-16f9-4a69-8b4e-3c4eff50eed4 None admin] RBAC: Authorizing `identity:get_project(project_id=b1cc3d93d0ea435c91ced02929b252f0)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:50.483850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0ba65-16f9-4a69-8b4e-3c4eff50eed4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:50.485530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 590/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:50 2022] GET /identity/v3/projects/b1cc3d93d0ea435c91ced02929b252f0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:50.491627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556ca17-5949-46b2-91eb-8022fa168668 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:50.506805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:50.590141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556ca17-5949-46b2-91eb-8022fa168668 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:50.623100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8d12e-b909-42c7-a6b3-f00c84766b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:50.623747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d12e-b909-42c7-a6b3-f00c84766b3e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:50.624034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d12e-b909-42c7-a6b3-f00c84766b3e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:50.624315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d12e-b909-42c7-a6b3-f00c84766b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:50.625138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8d12e-b909-42c7-a6b3-f00c84766b3e None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=b1cc3d93d0ea435c91ced02929b252f0, user.id=81356e64865d454a95ea14a65adc048d) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:50.625454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8d12e-b909-42c7-a6b3-f00c84766b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:50.626909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8d12e-b909-42c7-a6b3-f00c84766b3e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:50.632207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 595/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:34:50 2022] GET /identity/v3/role_assignments?user.id=81356e64865d454a95ea14a65adc048d&scope.project.id=b1cc3d93d0ea435c91ced02929b252f0&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:52.604687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f903d0-8384-4f01-a888-adc65ec46432 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.605244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f903d0-8384-4f01-a888-adc65ec46432 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.605244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f903d0-8384-4f01-a888-adc65ec46432 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.606687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 591/1186] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:52.611768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62f75-f401-42c3-b90c-d5ce20f34a12 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.612199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62f75-f401-42c3-b90c-d5ce20f34a12 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.612331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62f75-f401-42c3-b90c-d5ce20f34a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.630530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-cfe62f75-f401-42c3-b90c-d5ce20f34a12 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:52.631710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cfe62f75-f401-42c3-b90c-d5ce20f34a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:52.696557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 596/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:52.718935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f903d0-8384-4f01-a888-adc65ec46432 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.807897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:52.818628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f903d0-8384-4f01-a888-adc65ec46432 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:52.851209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ad871-69ac-4030-afe8-c0371a54b424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:52.851986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ad871-69ac-4030-afe8-c0371a54b424 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.852268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ad871-69ac-4030-afe8-c0371a54b424 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.852541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ad871-69ac-4030-afe8-c0371a54b424 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.862219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ad871-69ac-4030-afe8-c0371a54b424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-529ad871-69ac-4030-afe8-c0371a54b424 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:52.870161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:52.871262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:34:52.872310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 592/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:34:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:52.877590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe62f75-f401-42c3-b90c-d5ce20f34a12 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.888107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:52.974042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe62f75-f401-42c3-b90c-d5ce20f34a12 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:53.006516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9896a7-fc99-44c2-83a5-e03b7b9a8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:53.007166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9896a7-fc99-44c2-83a5-e03b7b9a8924 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:53.007448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9896a7-fc99-44c2-83a5-e03b7b9a8924 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:53.007723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9896a7-fc99-44c2-83a5-e03b7b9a8924 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:53.008462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9896a7-fc99-44c2-83a5-e03b7b9a8924 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:53.008764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9896a7-fc99-44c2-83a5-e03b7b9a8924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:53.010154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9896a7-fc99-44c2-83a5-e03b7b9a8924 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:53.017903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 597/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:34:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:53.023659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ad871-69ac-4030-afe8-c0371a54b424 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:53.120293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ad871-69ac-4030-afe8-c0371a54b424 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:53.151677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460dd5b-d3de-483b-8d9e-fd65ded6b74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:53.152535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460dd5b-d3de-483b-8d9e-fd65ded6b74e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:53.152822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460dd5b-d3de-483b-8d9e-fd65ded6b74e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:53.153099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460dd5b-d3de-483b-8d9e-fd65ded6b74e None admin] PATH_INFO: `/v3/users/81356e64865d454a95ea14a65adc048d` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:53.154297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460dd5b-d3de-483b-8d9e-fd65ded6b74e None admin] RBAC: Authorizing `identity:get_user(user_id=81356e64865d454a95ea14a65adc048d)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:53.155716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460dd5b-d3de-483b-8d9e-fd65ded6b74e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:53.157312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 593/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:53 2022] GET /identity/v3/users/81356e64865d454a95ea14a65adc048d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:53.163395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9896a7-fc99-44c2-83a5-e03b7b9a8924 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:53.229918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:53.259331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9896a7-fc99-44c2-83a5-e03b7b9a8924 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:53.291748 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bf6bf-c161-42bc-b5e3-0abd7eb935b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:53.292590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bf6bf-c161-42bc-b5e3-0abd7eb935b6 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:53.292873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bf6bf-c161-42bc-b5e3-0abd7eb935b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:53.293146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bf6bf-c161-42bc-b5e3-0abd7eb935b6 None admin] PATH_INFO: `/v3/projects/b1cc3d93d0ea435c91ced02929b252f0` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:53.294330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bf6bf-c161-42bc-b5e3-0abd7eb935b6 None admin] RBAC: Authorizing `identity:get_project(project_id=b1cc3d93d0ea435c91ced02929b252f0)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:53.295757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bf6bf-c161-42bc-b5e3-0abd7eb935b6 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:53.297409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 598/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:53 2022] GET /identity/v3/projects/b1cc3d93d0ea435c91ced02929b252f0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:53.303984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460dd5b-d3de-483b-8d9e-fd65ded6b74e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:53.322627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:53.399989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460dd5b-d3de-483b-8d9e-fd65ded6b74e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:53.432105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1386f97-03f4-44a0-8b02-2e9d820f7a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:53.432975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386f97-03f4-44a0-8b02-2e9d820f7a56 None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:53.433253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386f97-03f4-44a0-8b02-2e9d820f7a56 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:53.433525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386f97-03f4-44a0-8b02-2e9d820f7a56 None admin] PATH_INFO: `/v3/projects/b1cc3d93d0ea435c91ced02929b252f0/users/81356e64865d454a95ea14a65adc048d/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:53.435462 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1386f97-03f4-44a0-8b02-2e9d820f7a56 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1cc3d93d0ea435c91ced02929b252f0, user_id=81356e64865d454a95ea14a65adc048d, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:53.436879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1386f97-03f4-44a0-8b02-2e9d820f7a56 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:53.499722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 594/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:34:53 2022] PUT /identity/v3/projects/b1cc3d93d0ea435c91ced02929b252f0/users/81356e64865d454a95ea14a65adc048d/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:55.525502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8772d1b-4e5b-45e0-93dd-5c4140d600ae None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:55.526099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8772d1b-4e5b-45e0-93dd-5c4140d600ae None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:55.526291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8772d1b-4e5b-45e0-93dd-5c4140d600ae None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:55.527672 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 599/1193] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:55.532675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a2af3-5e74-4700-b866-2a439fc6f4c4 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:55.533095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a2af3-5e74-4700-b866-2a439fc6f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:55.533240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a2af3-5e74-4700-b866-2a439fc6f4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:55.549401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3c3a2af3-5e74-4700-b866-2a439fc6f4c4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:55.550641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3c3a2af3-5e74-4700-b866-2a439fc6f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:55.615321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 595/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:34:55.638927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8772d1b-4e5b-45e0-93dd-5c4140d600ae None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:55.737295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8772d1b-4e5b-45e0-93dd-5c4140d600ae None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:55.770743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23954f4-f248-409e-83ca-5a6e595037f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:55.771523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23954f4-f248-409e-83ca-5a6e595037f6 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:55.771808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23954f4-f248-409e-83ca-5a6e595037f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:55.772085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23954f4-f248-409e-83ca-5a6e595037f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:55.778992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:55.783232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23954f4-f248-409e-83ca-5a6e595037f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-d23954f4-f248-409e-83ca-5a6e595037f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:34:55.790956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:34:55.792059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:34:55.793020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 600/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:34:55.798128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a2af3-5e74-4700-b866-2a439fc6f4c4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:55.808558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:55.894688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a2af3-5e74-4700-b866-2a439fc6f4c4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:55.928938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3f69-5cc9-42e4-aac2-20ade2dc1ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:55.929644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3f69-5cc9-42e4-aac2-20ade2dc1ecc None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:55.929933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3f69-5cc9-42e4-aac2-20ade2dc1ecc None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:55.930249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3f69-5cc9-42e4-aac2-20ade2dc1ecc None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:55.931029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c3f69-5cc9-42e4-aac2-20ade2dc1ecc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:55.931342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c3f69-5cc9-42e4-aac2-20ade2dc1ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:55.932716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c3f69-5cc9-42e4-aac2-20ade2dc1ecc None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:55.940767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 596/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:34:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:55.947100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23954f4-f248-409e-83ca-5a6e595037f6 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:56.044216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23954f4-f248-409e-83ca-5a6e595037f6 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:56.077050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69666-ca2c-4a10-8e85-0bb671505602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:56.077901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69666-ca2c-4a10-8e85-0bb671505602 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:56.078217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69666-ca2c-4a10-8e85-0bb671505602 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:56.078499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69666-ca2c-4a10-8e85-0bb671505602 None admin] PATH_INFO: `/v3/users/81356e64865d454a95ea14a65adc048d` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:56.079673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d69666-ca2c-4a10-8e85-0bb671505602 None admin] RBAC: Authorizing `identity:get_user(user_id=81356e64865d454a95ea14a65adc048d)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:56.081110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d69666-ca2c-4a10-8e85-0bb671505602 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:56.082764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 601/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jun 30 10:34:55 2022] GET /identity/v3/users/81356e64865d454a95ea14a65adc048d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:56.088317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3f69-5cc9-42e4-aac2-20ade2dc1ecc None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:56.154661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:56.184404 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3f69-5cc9-42e4-aac2-20ade2dc1ecc None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:56.216834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25330b5d-246b-4549-9a4e-0e5ee9347649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:56.217472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25330b5d-246b-4549-9a4e-0e5ee9347649 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:56.217759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25330b5d-246b-4549-9a4e-0e5ee9347649 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:56.218071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25330b5d-246b-4549-9a4e-0e5ee9347649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:56.283118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25330b5d-246b-4549-9a4e-0e5ee9347649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:56.285056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25330b5d-246b-4549-9a4e-0e5ee9347649 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:56.348786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:56.378931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 597/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:34:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:34:56.384776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69666-ca2c-4a10-8e85-0bb671505602 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:56.448541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:56.482960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69666-ca2c-4a10-8e85-0bb671505602 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:56.516573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da39d7f-5a8a-4afa-91be-69d61d4419ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:56.517413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39d7f-5a8a-4afa-91be-69d61d4419ef None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:56.517701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39d7f-5a8a-4afa-91be-69d61d4419ef None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:56.518006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39d7f-5a8a-4afa-91be-69d61d4419ef None admin] PATH_INFO: `/v3/projects/b1cc3d93d0ea435c91ced02929b252f0` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:56.519688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da39d7f-5a8a-4afa-91be-69d61d4419ef None admin] RBAC: Authorizing `identity:get_project(project_id=b1cc3d93d0ea435c91ced02929b252f0)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:56.521126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da39d7f-5a8a-4afa-91be-69d61d4419ef None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:56.522856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 602/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jun 30 10:34:56 2022] GET /identity/v3/projects/b1cc3d93d0ea435c91ced02929b252f0 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:56.529357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25330b5d-246b-4549-9a4e-0e5ee9347649 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:56.624895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25330b5d-246b-4549-9a4e-0e5ee9347649 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:56.656784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76682c2-5dae-420b-81e3-8414c1017eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:56.657413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76682c2-5dae-420b-81e3-8414c1017eac None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:56.657692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76682c2-5dae-420b-81e3-8414c1017eac None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:56.657982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76682c2-5dae-420b-81e3-8414c1017eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:56.658802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76682c2-5dae-420b-81e3-8414c1017eac None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=b1cc3d93d0ea435c91ced02929b252f0, user.id=81356e64865d454a95ea14a65adc048d) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:56.659112 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76682c2-5dae-420b-81e3-8414c1017eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:56.661096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76682c2-5dae-420b-81e3-8414c1017eac None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:56.666725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 598/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:34:56 2022] GET /identity/v3/role_assignments?user.id=81356e64865d454a95ea14a65adc048d&scope.project.id=b1cc3d93d0ea435c91ced02929b252f0&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:35:06.512439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=33 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:35:06.664201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=83 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:09.020751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c749b-ec0b-47df-945d-3007fda4d687 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:09.021327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c749b-ec0b-47df-945d-3007fda4d687 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:09.021327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c749b-ec0b-47df-945d-3007fda4d687 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:09.022747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 603/1201] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:36:09.027830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfaf64-5f36-41ed-a48f-76bf56c8ef89 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:09.028263 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfaf64-5f36-41ed-a48f-76bf56c8ef89 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:09.028369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfaf64-5f36-41ed-a48f-76bf56c8ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:09.045163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9edfaf64-5f36-41ed-a48f-76bf56c8ef89 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:09.046362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9edfaf64-5f36-41ed-a48f-76bf56c8ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:09.111515 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 599/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:09.135650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c749b-ec0b-47df-945d-3007fda4d687 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:09.236387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c749b-ec0b-47df-945d-3007fda4d687 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:09.270153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8d51-e503-4d7d-8a33-55502714db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:09.270937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8d51-e503-4d7d-8a33-55502714db83 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:09.271220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8d51-e503-4d7d-8a33-55502714db83 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:09.271494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8d51-e503-4d7d-8a33-55502714db83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:09.281435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a8d51-e503-4d7d-8a33-55502714db83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:09.283832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a8d51-e503-4d7d-8a33-55502714db83 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-c09a8d51-e503-4d7d-8a33-55502714db83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:09.303226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:09.304459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:09.305626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:09.305626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:09.305626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:09.305626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:09.305626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 604/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:09.311236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfaf64-5f36-41ed-a48f-76bf56c8ef89 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:09.408680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfaf64-5f36-41ed-a48f-76bf56c8ef89 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:09.436506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:09.442037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a1c63-3973-41dc-b0bd-35431af43f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:09.442734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1c63-3973-41dc-b0bd-35431af43f32 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:09.443022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1c63-3973-41dc-b0bd-35431af43f32 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:09.443307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1c63-3973-41dc-b0bd-35431af43f32 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:09.444020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a1c63-3973-41dc-b0bd-35431af43f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:09.444326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a1c63-3973-41dc-b0bd-35431af43f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:09.445687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a1c63-3973-41dc-b0bd-35431af43f32 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:09.456725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 600/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:09.462336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8d51-e503-4d7d-8a33-55502714db83 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:09.516060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:09.562311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8d51-e503-4d7d-8a33-55502714db83 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:09.595563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b3e23-b6a2-46d5-8707-0e8d718da7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:09.596226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b3e23-b6a2-46d5-8707-0e8d718da7f8 None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:09.596513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b3e23-b6a2-46d5-8707-0e8d718da7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:09.596799 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b3e23-b6a2-46d5-8707-0e8d718da7f8 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:09.597495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b3e23-b6a2-46d5-8707-0e8d718da7f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:09.598976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b3e23-b6a2-46d5-8707-0e8d718da7f8 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:09.726038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 605/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jun 30 10:36:09 2022] POST /identity/v3/users => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:36:11.758571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4637e2-ade1-41ac-b8af-ec45c7a62815 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:11.759152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4637e2-ade1-41ac-b8af-ec45c7a62815 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:11.759152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4637e2-ade1-41ac-b8af-ec45c7a62815 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:11.760511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 601/1206] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:11.765675 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582b9a-0b51-49b9-90c5-4c52a06fdc65 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:11.766100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582b9a-0b51-49b9-90c5-4c52a06fdc65 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:11.766274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582b9a-0b51-49b9-90c5-4c52a06fdc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:11.783383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ff582b9a-0b51-49b9-90c5-4c52a06fdc65 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:11.784551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ff582b9a-0b51-49b9-90c5-4c52a06fdc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:11.848865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 606/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:11.871635 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4637e2-ade1-41ac-b8af-ec45c7a62815 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:11.973629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4637e2-ade1-41ac-b8af-ec45c7a62815 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:12.006536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c049e8-32ec-4c7d-8421-69cc370573b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:12.007331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c049e8-32ec-4c7d-8421-69cc370573b5 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:12.007624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c049e8-32ec-4c7d-8421-69cc370573b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:12.007908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c049e8-32ec-4c7d-8421-69cc370573b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:12.019202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c049e8-32ec-4c7d-8421-69cc370573b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-b1c049e8-32ec-4c7d-8421-69cc370573b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:36:12.026835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:12.027921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:12.028820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 602/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:12.034074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582b9a-0b51-49b9-90c5-4c52a06fdc65 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:12.072940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:12.130157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582b9a-0b51-49b9-90c5-4c52a06fdc65 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:12.161915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0b3da-a802-48a3-babe-c17710e19577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:12.162595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0b3da-a802-48a3-babe-c17710e19577 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:12.162879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0b3da-a802-48a3-babe-c17710e19577 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:12.163152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0b3da-a802-48a3-babe-c17710e19577 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:12.163894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0b3da-a802-48a3-babe-c17710e19577 None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:12.164200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0b3da-a802-48a3-babe-c17710e19577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:12.165563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0b3da-a802-48a3-babe-c17710e19577 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:12.175021 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 607/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:12.180752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c049e8-32ec-4c7d-8421-69cc370573b5 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:12.230268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:12.279519 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c049e8-32ec-4c7d-8421-69cc370573b5 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:12.312350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51de2e-4f16-4d71-8bd9-47b55de72ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:12.313127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51de2e-4f16-4d71-8bd9-47b55de72ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:12.313414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51de2e-4f16-4d71-8bd9-47b55de72ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:12.314313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51de2e-4f16-4d71-8bd9-47b55de72ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:12.324655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51de2e-4f16-4d71-8bd9-47b55de72ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:12.326122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51de2e-4f16-4d71-8bd9-47b55de72ba0 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-7e51de2e-4f16-4d71-8bd9-47b55de72ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:12.342885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:12.344140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:12.345499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:12.345499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:12.345499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:12.345499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:12.345499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 603/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:12.350076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0b3da-a802-48a3-babe-c17710e19577 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:12.447297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:12.450080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0b3da-a802-48a3-babe-c17710e19577 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:12.483177 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d907bb-1984-4c47-b7e7-75481a69b546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:12.483842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d907bb-1984-4c47-b7e7-75481a69b546 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:12.484129 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d907bb-1984-4c47-b7e7-75481a69b546 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:12.484406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d907bb-1984-4c47-b7e7-75481a69b546 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:12.485172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d907bb-1984-4c47-b7e7-75481a69b546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:12.485485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d907bb-1984-4c47-b7e7-75481a69b546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:12.488693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d907bb-1984-4c47-b7e7-75481a69b546 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:12.501923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 608/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:12.507525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51de2e-4f16-4d71-8bd9-47b55de72ba0 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:12.604885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51de2e-4f16-4d71-8bd9-47b55de72ba0 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:12.606429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:12.637522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211af6e-45d6-4093-b68d-913a3712e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:12.638341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211af6e-45d6-4093-b68d-913a3712e838 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:12.638629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211af6e-45d6-4093-b68d-913a3712e838 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:12.638944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211af6e-45d6-4093-b68d-913a3712e838 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:12.646990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211af6e-45d6-4093-b68d-913a3712e838 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:12.648430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211af6e-45d6-4093-b68d-913a3712e838 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-5211af6e-45d6-4093-b68d-913a3712e838 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:36:12.663056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:12.664035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:12.666203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 604/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:12.670244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d907bb-1984-4c47-b7e7-75481a69b546 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:12.769806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d907bb-1984-4c47-b7e7-75481a69b546 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:12.805700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703223b-1947-47f6-b381-e69625a95d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:12.806400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703223b-1947-47f6-b381-e69625a95d31 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:12.806687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703223b-1947-47f6-b381-e69625a95d31 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:12.806964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703223b-1947-47f6-b381-e69625a95d31 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:12.807791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703223b-1947-47f6-b381-e69625a95d31 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:12.808107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703223b-1947-47f6-b381-e69625a95d31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:12.809542 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703223b-1947-47f6-b381-e69625a95d31 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:12.827242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 609/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 10:36:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:12.833298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211af6e-45d6-4093-b68d-913a3712e838 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:12.934456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211af6e-45d6-4093-b68d-913a3712e838 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:12.971623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c54d3-1f97-4bf6-991d-4371a416cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:12.972275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c54d3-1f97-4bf6-991d-4371a416cd85 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:12.972566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c54d3-1f97-4bf6-991d-4371a416cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:12.972851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c54d3-1f97-4bf6-991d-4371a416cd85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:13.002392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:13.038536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c54d3-1f97-4bf6-991d-4371a416cd85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:13.039997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c54d3-1f97-4bf6-991d-4371a416cd85 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:13.137037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 605/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:36:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:36:13.143136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703223b-1947-47f6-b381-e69625a95d31 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:13.162249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:13.240623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703223b-1947-47f6-b381-e69625a95d31 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:13.273493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1d7f6-d6e1-47fa-8bc7-3b65d6d66fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:13.274297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1d7f6-d6e1-47fa-8bc7-3b65d6d66fb0 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:13.274581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1d7f6-d6e1-47fa-8bc7-3b65d6d66fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:13.274858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1d7f6-d6e1-47fa-8bc7-3b65d6d66fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:13.285265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1d7f6-d6e1-47fa-8bc7-3b65d6d66fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:13.286741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1d7f6-d6e1-47fa-8bc7-3b65d6d66fb0 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-f5b1d7f6-d6e1-47fa-8bc7-3b65d6d66fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:13.304539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:13.305537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:13.306472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:13.306472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:13.306472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:13.306472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:13.306472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 610/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:36:13.311695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c54d3-1f97-4bf6-991d-4371a416cd85 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:13.371644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:13.408758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c54d3-1f97-4bf6-991d-4371a416cd85 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:13.443178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f5194-a1a2-482b-a950-f3face8116d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:13.443833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f5194-a1a2-482b-a950-f3face8116d7 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:13.444117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f5194-a1a2-482b-a950-f3face8116d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:13.444389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f5194-a1a2-482b-a950-f3face8116d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:13.445101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f5194-a1a2-482b-a950-f3face8116d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:13.445406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f5194-a1a2-482b-a950-f3face8116d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:13.446820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f5194-a1a2-482b-a950-f3face8116d7 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:13.458147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 606/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:13.463855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1d7f6-d6e1-47fa-8bc7-3b65d6d66fb0 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:13.532996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:13.563186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1d7f6-d6e1-47fa-8bc7-3b65d6d66fb0 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:13.597214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8accf-7828-45fc-9334-336734497959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:13.598028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8accf-7828-45fc-9334-336734497959 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:13.598314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8accf-7828-45fc-9334-336734497959 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:13.598588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8accf-7828-45fc-9334-336734497959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:13.605033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8accf-7828-45fc-9334-336734497959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:13.606502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8accf-7828-45fc-9334-336734497959 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-23b8accf-7828-45fc-9334-336734497959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:36:13.619718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:13.620793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:13.621919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:36:13.621919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:36:13.621919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:36:13.621919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:36:13.621919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:36:13.621919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:36:13.621919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:13.621919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:13.621919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 611/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:36:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:13.626893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f5194-a1a2-482b-a950-f3face8116d7 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:13.724892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f5194-a1a2-482b-a950-f3face8116d7 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:13.749161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:13.761003 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6478d2-ce15-4f06-8afc-95de02f87142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:13.761664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6478d2-ce15-4f06-8afc-95de02f87142 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:13.761970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6478d2-ce15-4f06-8afc-95de02f87142 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:13.762263 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6478d2-ce15-4f06-8afc-95de02f87142 None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:13.763054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6478d2-ce15-4f06-8afc-95de02f87142 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:13.763371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6478d2-ce15-4f06-8afc-95de02f87142 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:13.764791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6478d2-ce15-4f06-8afc-95de02f87142 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:13.776527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 607/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:13.782761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8accf-7828-45fc-9334-336734497959 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:13.885699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8accf-7828-45fc-9334-336734497959 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:13.914705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:13.920504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444ad2b-132d-4575-b2b4-80dd91952564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:13.921241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ad2b-132d-4575-b2b4-80dd91952564 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:13.921526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ad2b-132d-4575-b2b4-80dd91952564 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:13.921807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ad2b-132d-4575-b2b4-80dd91952564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:13.922678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444ad2b-132d-4575-b2b4-80dd91952564 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=3238a52a3f6047e0acb0136ab39257e8) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:13.923631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444ad2b-132d-4575-b2b4-80dd91952564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:13.925069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444ad2b-132d-4575-b2b4-80dd91952564 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:13.930533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 612/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:36:13 2022] GET /identity/v3/role_assignments?user.id=3238a52a3f6047e0acb0136ab39257e8&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:15.929338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f8f9-81f2-4c49-a524-5547735568b6 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:15.936640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f8f9-81f2-4c49-a524-5547735568b6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:15.936640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f8f9-81f2-4c49-a524-5547735568b6 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:15.936640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 608/1220] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:15.936895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946f00-0a2c-4444-a3b4-ec87acddb760 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:15.936895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946f00-0a2c-4444-a3b4-ec87acddb760 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:15.937339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946f00-0a2c-4444-a3b4-ec87acddb760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:15.953702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d1946f00-0a2c-4444-a3b4-ec87acddb760 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:15.955416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d1946f00-0a2c-4444-a3b4-ec87acddb760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:16.021769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 613/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:16.045228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f8f9-81f2-4c49-a524-5547735568b6 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:16.146772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f8f9-81f2-4c49-a524-5547735568b6 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:16.179801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14efdf-2645-4071-925b-08dd920ac222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:16.180590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14efdf-2645-4071-925b-08dd920ac222 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:16.180878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14efdf-2645-4071-925b-08dd920ac222 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:16.181157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14efdf-2645-4071-925b-08dd920ac222 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:16.191629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14efdf-2645-4071-925b-08dd920ac222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-be14efdf-2645-4071-925b-08dd920ac222 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:36:16.199382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:16.204667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:16.205720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 609/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:16.207361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1946f00-0a2c-4444-a3b4-ec87acddb760 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:16.303810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1946f00-0a2c-4444-a3b4-ec87acddb760 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:16.326832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:16.337827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b1ce-1cc2-4657-a078-68c9c94bb354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:16.338521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b1ce-1cc2-4657-a078-68c9c94bb354 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:16.338806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b1ce-1cc2-4657-a078-68c9c94bb354 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:16.339085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b1ce-1cc2-4657-a078-68c9c94bb354 None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:16.339829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b1ce-1cc2-4657-a078-68c9c94bb354 None admin] RBAC: Adding query filter params (name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:16.340138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b1ce-1cc2-4657-a078-68c9c94bb354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:16.341506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b1ce-1cc2-4657-a078-68c9c94bb354 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:16.349630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 614/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:16.355445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14efdf-2645-4071-925b-08dd920ac222 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:16.398530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:16.454842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14efdf-2645-4071-925b-08dd920ac222 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:16.488045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f268f-c910-4886-9452-7db878ba7b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:16.488830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f268f-c910-4886-9452-7db878ba7b94 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:16.489122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f268f-c910-4886-9452-7db878ba7b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:16.489405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f268f-c910-4886-9452-7db878ba7b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:16.499667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f268f-c910-4886-9452-7db878ba7b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:16.501632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f268f-c910-4886-9452-7db878ba7b94 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-3a6f268f-c910-4886-9452-7db878ba7b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:16.518843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:16.522178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:16.523323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:16.523323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:16.523323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:16.523323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:16.523323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 610/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:16.525820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b1ce-1cc2-4657-a078-68c9c94bb354 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:16.624945 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b1ce-1cc2-4657-a078-68c9c94bb354 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:16.658089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185c789-4743-493f-b1ff-90ad7d2d30e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:16.658679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185c789-4743-493f-b1ff-90ad7d2d30e9 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:16.658965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185c789-4743-493f-b1ff-90ad7d2d30e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:16.659245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185c789-4743-493f-b1ff-90ad7d2d30e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:16.659960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185c789-4743-493f-b1ff-90ad7d2d30e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:16.660268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185c789-4743-493f-b1ff-90ad7d2d30e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:16.661640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185c789-4743-493f-b1ff-90ad7d2d30e9 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:16.673996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 615/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:16.679574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f268f-c910-4886-9452-7db878ba7b94 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:16.771315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:16.777691 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f268f-c910-4886-9452-7db878ba7b94 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:16.810313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742ae60-b928-491c-bb68-148d92b545e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:16.811121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742ae60-b928-491c-bb68-148d92b545e4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:16.811397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742ae60-b928-491c-bb68-148d92b545e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:16.811677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742ae60-b928-491c-bb68-148d92b545e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:16.819171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742ae60-b928-491c-bb68-148d92b545e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:16.820987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742ae60-b928-491c-bb68-148d92b545e4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-7742ae60-b928-491c-bb68-148d92b545e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:36:16.836305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:16.837453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:16.838693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 611/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:16.843813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185c789-4743-493f-b1ff-90ad7d2d30e9 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:16.890794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:16.944353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185c789-4743-493f-b1ff-90ad7d2d30e9 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:16.978091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f6a25-015d-4949-90e8-d4a7882d2828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:16.978751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f6a25-015d-4949-90e8-d4a7882d2828 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:16.979038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f6a25-015d-4949-90e8-d4a7882d2828 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:16.979312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f6a25-015d-4949-90e8-d4a7882d2828 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:16.980199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f6a25-015d-4949-90e8-d4a7882d2828 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:16.980509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f6a25-015d-4949-90e8-d4a7882d2828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:16.981933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f6a25-015d-4949-90e8-d4a7882d2828 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:16.999629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 616/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 10:36:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:17.005351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742ae60-b928-491c-bb68-148d92b545e4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:17.103114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742ae60-b928-491c-bb68-148d92b545e4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:17.136177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816596c-9577-411c-9f95-59a9c0fddc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:17.136961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816596c-9577-411c-9f95-59a9c0fddc28 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:17.137346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816596c-9577-411c-9f95-59a9c0fddc28 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:17.137626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816596c-9577-411c-9f95-59a9c0fddc28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:17.147444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816596c-9577-411c-9f95-59a9c0fddc28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:17.148873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816596c-9577-411c-9f95-59a9c0fddc28 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-8816596c-9577-411c-9f95-59a9c0fddc28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:17.167164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:17.168291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:17.169363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:17.169363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:17.169363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:17.169363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:17.169363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 612/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:17.174740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f6a25-015d-4949-90e8-d4a7882d2828 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:17.272016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f6a25-015d-4949-90e8-d4a7882d2828 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:17.274369 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:17.305634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bafcc-88e2-4768-9e08-f1772ea9db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:17.306315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bafcc-88e2-4768-9e08-f1772ea9db7c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:17.306602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bafcc-88e2-4768-9e08-f1772ea9db7c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:17.306879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bafcc-88e2-4768-9e08-f1772ea9db7c None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:17.307612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bafcc-88e2-4768-9e08-f1772ea9db7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:17.307906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bafcc-88e2-4768-9e08-f1772ea9db7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:17.309272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bafcc-88e2-4768-9e08-f1772ea9db7c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:17.320164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 617/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:17.325920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816596c-9577-411c-9f95-59a9c0fddc28 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:17.335189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:17.423778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816596c-9577-411c-9f95-59a9c0fddc28 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:17.456202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aa682-3721-422f-a985-fc4b20a9842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:17.457277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aa682-3721-422f-a985-fc4b20a9842d None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:17.457753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aa682-3721-422f-a985-fc4b20a9842d None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:17.458792 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aa682-3721-422f-a985-fc4b20a9842d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:17.465357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aa682-3721-422f-a985-fc4b20a9842d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:17.466832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aa682-3721-422f-a985-fc4b20a9842d None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-c06aa682-3721-422f-a985-fc4b20a9842d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:36:17.481104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:17.482236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:17.483353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:36:17.483353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:36:17.483353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:36:17.483353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:36:17.483353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:36:17.483353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:36:17.483353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:17.483353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:17.483353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 613/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:36:17.488311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bafcc-88e2-4768-9e08-f1772ea9db7c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:17.592139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bafcc-88e2-4768-9e08-f1772ea9db7c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:17.625852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a519fe2-8310-4e6d-8fca-6b3a930aae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:17.626593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a519fe2-8310-4e6d-8fca-6b3a930aae7a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:17.626879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a519fe2-8310-4e6d-8fca-6b3a930aae7a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:17.627156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a519fe2-8310-4e6d-8fca-6b3a930aae7a None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:17.627941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a519fe2-8310-4e6d-8fca-6b3a930aae7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:17.628256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a519fe2-8310-4e6d-8fca-6b3a930aae7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:17.629685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a519fe2-8310-4e6d-8fca-6b3a930aae7a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:17.642258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 618/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:17.648326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aa682-3721-422f-a985-fc4b20a9842d None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:17.712594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:17.746236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aa682-3721-422f-a985-fc4b20a9842d None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:17.780542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322f98e-22e9-4b54-8ffc-572bd1c426f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:17.781429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322f98e-22e9-4b54-8ffc-572bd1c426f6 None admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:17.781717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322f98e-22e9-4b54-8ffc-572bd1c426f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:17.782066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322f98e-22e9-4b54-8ffc-572bd1c426f6 None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/3238a52a3f6047e0acb0136ab39257e8/roles/449d76dce6534ca9b28d0a003483d951` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:17.796226 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322f98e-22e9-4b54-8ffc-572bd1c426f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=3238a52a3f6047e0acb0136ab39257e8, role_id=449d76dce6534ca9b28d0a003483d951)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:17.797964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322f98e-22e9-4b54-8ffc-572bd1c426f6 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:17.863011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 614/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:36:17 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/3238a52a3f6047e0acb0136ab39257e8/roles/449d76dce6534ca9b28d0a003483d951 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:36:19.845660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2b1d-665f-49ea-96b9-0fe0df6cbe00 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:19.846223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2b1d-665f-49ea-96b9-0fe0df6cbe00 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:19.846314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2b1d-665f-49ea-96b9-0fe0df6cbe00 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:19.847623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 619/1233] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:19.852650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566a2b4-fd23-46ec-8899-7292fef4315c None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:19.853081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566a2b4-fd23-46ec-8899-7292fef4315c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:19.853243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566a2b4-fd23-46ec-8899-7292fef4315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:19.870108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-0566a2b4-fd23-46ec-8899-7292fef4315c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:19.871285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-0566a2b4-fd23-46ec-8899-7292fef4315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:19.942689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 615/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:19.966429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2b1d-665f-49ea-96b9-0fe0df6cbe00 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:19.992955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:20.067258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2b1d-665f-49ea-96b9-0fe0df6cbe00 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:20.103108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b1c1b-2afd-4dd4-b0b8-c25c8ede0a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:20.103827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b1c1b-2afd-4dd4-b0b8-c25c8ede0a1d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:20.104119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b1c1b-2afd-4dd4-b0b8-c25c8ede0a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:20.104401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b1c1b-2afd-4dd4-b0b8-c25c8ede0a1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:20.115305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b1c1b-2afd-4dd4-b0b8-c25c8ede0a1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-435b1c1b-2afd-4dd4-b0b8-c25c8ede0a1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:36:20.123034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:20.124241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:20.125217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 620/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jun 30 10:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:20.130209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566a2b4-fd23-46ec-8899-7292fef4315c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:20.176410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:20.227267 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566a2b4-fd23-46ec-8899-7292fef4315c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:20.259358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce56ad2-75ee-4c1d-97a9-172518183fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:20.260045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce56ad2-75ee-4c1d-97a9-172518183fbb None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:20.260333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce56ad2-75ee-4c1d-97a9-172518183fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:20.260607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce56ad2-75ee-4c1d-97a9-172518183fbb None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:20.261345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce56ad2-75ee-4c1d-97a9-172518183fbb None admin] RBAC: Adding query filter params (name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:20.261652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce56ad2-75ee-4c1d-97a9-172518183fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:20.263042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce56ad2-75ee-4c1d-97a9-172518183fbb None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:20.272306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 616/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jun 30 10:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:20.277980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b1c1b-2afd-4dd4-b0b8-c25c8ede0a1d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:20.362163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:20.377435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b1c1b-2afd-4dd4-b0b8-c25c8ede0a1d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:20.411168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa229d87-3b6f-40d3-98c6-665562a82aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:20.411986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229d87-3b6f-40d3-98c6-665562a82aa6 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:20.412279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229d87-3b6f-40d3-98c6-665562a82aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:20.412562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229d87-3b6f-40d3-98c6-665562a82aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:20.422987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa229d87-3b6f-40d3-98c6-665562a82aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:20.424438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa229d87-3b6f-40d3-98c6-665562a82aa6 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-aa229d87-3b6f-40d3-98c6-665562a82aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:20.441190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:20.447365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:20.448523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:20.448523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:20.448523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:20.448523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:20.448523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 621/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:20.448898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce56ad2-75ee-4c1d-97a9-172518183fbb None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:20.555257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce56ad2-75ee-4c1d-97a9-172518183fbb None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:20.564634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:20.588669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51062b85-7a5c-4eb2-9014-b21c86c4f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:20.589326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062b85-7a5c-4eb2-9014-b21c86c4f3ad None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:20.589611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062b85-7a5c-4eb2-9014-b21c86c4f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:20.589886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062b85-7a5c-4eb2-9014-b21c86c4f3ad None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:20.590631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51062b85-7a5c-4eb2-9014-b21c86c4f3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:20.590938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51062b85-7a5c-4eb2-9014-b21c86c4f3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:20.592312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51062b85-7a5c-4eb2-9014-b21c86c4f3ad None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:20.604107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 617/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:36:20.609983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa229d87-3b6f-40d3-98c6-665562a82aa6 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:20.711940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa229d87-3b6f-40d3-98c6-665562a82aa6 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:20.745140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30182d27-8810-46c4-80de-bebdb2614540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:20.745920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30182d27-8810-46c4-80de-bebdb2614540 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:20.746229 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30182d27-8810-46c4-80de-bebdb2614540 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:20.746505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30182d27-8810-46c4-80de-bebdb2614540 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:20.749296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:20.754891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30182d27-8810-46c4-80de-bebdb2614540 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:20.756413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30182d27-8810-46c4-80de-bebdb2614540 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-30182d27-8810-46c4-80de-bebdb2614540 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:36:20.771385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:20.772605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:20.773760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 622/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:20.778354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51062b85-7a5c-4eb2-9014-b21c86c4f3ad None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:20.878027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51062b85-7a5c-4eb2-9014-b21c86c4f3ad None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:20.911189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc632a-cb79-4c59-8eef-172cfc2673f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:20.911856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc632a-cb79-4c59-8eef-172cfc2673f1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:20.912144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc632a-cb79-4c59-8eef-172cfc2673f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:20.912423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc632a-cb79-4c59-8eef-172cfc2673f1 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:20.913256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc632a-cb79-4c59-8eef-172cfc2673f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:20.913569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc632a-cb79-4c59-8eef-172cfc2673f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:20.915034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc632a-cb79-4c59-8eef-172cfc2673f1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:20.932733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 618/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 10:36:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:20.939219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30182d27-8810-46c4-80de-bebdb2614540 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:21.040211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30182d27-8810-46c4-80de-bebdb2614540 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:21.074886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172250b8-917d-40b9-b1b0-70cb82546407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:21.075530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172250b8-917d-40b9-b1b0-70cb82546407 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:21.075812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172250b8-917d-40b9-b1b0-70cb82546407 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:21.076085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172250b8-917d-40b9-b1b0-70cb82546407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:21.137385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:21.145089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172250b8-917d-40b9-b1b0-70cb82546407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:21.146708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172250b8-917d-40b9-b1b0-70cb82546407 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:21.243983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 623/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:36:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:36:21.249700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc632a-cb79-4c59-8eef-172cfc2673f1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:21.276974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:21.347483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc632a-cb79-4c59-8eef-172cfc2673f1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:21.382109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51476213-b084-4264-8391-d1e695c7628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:21.382899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51476213-b084-4264-8391-d1e695c7628a None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:21.383192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51476213-b084-4264-8391-d1e695c7628a None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:21.383473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51476213-b084-4264-8391-d1e695c7628a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:21.393740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51476213-b084-4264-8391-d1e695c7628a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:21.395214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51476213-b084-4264-8391-d1e695c7628a None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-51476213-b084-4264-8391-d1e695c7628a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:21.412768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:21.413795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:21.414963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:21.414963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:21.414963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:21.414963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:21.414963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 619/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:21.419746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172250b8-917d-40b9-b1b0-70cb82546407 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:21.513082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:21.519439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172250b8-917d-40b9-b1b0-70cb82546407 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:21.552445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc815-9a9d-4298-8233-8ddbb6131aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:21.553107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc815-9a9d-4298-8233-8ddbb6131aeb None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:21.553396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc815-9a9d-4298-8233-8ddbb6131aeb None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:21.553680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc815-9a9d-4298-8233-8ddbb6131aeb None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:21.554432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc815-9a9d-4298-8233-8ddbb6131aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:21.554749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc815-9a9d-4298-8233-8ddbb6131aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:21.556173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc815-9a9d-4298-8233-8ddbb6131aeb None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:21.567907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 624/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:21.573558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51476213-b084-4264-8391-d1e695c7628a None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:21.650154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:21.670590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51476213-b084-4264-8391-d1e695c7628a None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:21.703467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab11c2-ea02-4345-98b9-85b3e8f02a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:21.704854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab11c2-ea02-4345-98b9-85b3e8f02a71 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:21.705139 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab11c2-ea02-4345-98b9-85b3e8f02a71 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:21.705417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab11c2-ea02-4345-98b9-85b3e8f02a71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:21.711899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab11c2-ea02-4345-98b9-85b3e8f02a71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:21.713394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab11c2-ea02-4345-98b9-85b3e8f02a71 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-57ab11c2-ea02-4345-98b9-85b3e8f02a71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:36:21.728061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:21.729124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:21.730258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:36:21.730258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:36:21.730258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:36:21.730258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:36:21.730258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:36:21.730258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:36:21.730258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:21.730258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:21.730258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 620/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:21.735043 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc815-9a9d-4298-8233-8ddbb6131aeb None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:21.833964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc815-9a9d-4298-8233-8ddbb6131aeb None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:21.867659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27d872-497c-451e-a1a1-60a232d49f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:21.868313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27d872-497c-451e-a1a1-60a232d49f75 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:21.868596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27d872-497c-451e-a1a1-60a232d49f75 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:21.868871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27d872-497c-451e-a1a1-60a232d49f75 None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:21.869649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27d872-497c-451e-a1a1-60a232d49f75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:21.869978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27d872-497c-451e-a1a1-60a232d49f75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:21.871404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27d872-497c-451e-a1a1-60a232d49f75 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:21.883804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 625/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:21.889839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab11c2-ea02-4345-98b9-85b3e8f02a71 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:21.988360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab11c2-ea02-4345-98b9-85b3e8f02a71 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:22.020883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b45cca-c028-448b-83aa-61ad7db7c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:22.021528 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45cca-c028-448b-83aa-61ad7db7c701 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:22.021810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45cca-c028-448b-83aa-61ad7db7c701 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:22.022122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45cca-c028-448b-83aa-61ad7db7c701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:22.022946 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b45cca-c028-448b-83aa-61ad7db7c701 None admin] RBAC: Adding query filter params (role.id=449d76dce6534ca9b28d0a003483d951, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=3238a52a3f6047e0acb0136ab39257e8) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:22.023258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b45cca-c028-448b-83aa-61ad7db7c701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:22.024694 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b45cca-c028-448b-83aa-61ad7db7c701 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:22.030351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 621/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:36:21 2022] GET /identity/v3/role_assignments?user.id=3238a52a3f6047e0acb0136ab39257e8&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=449d76dce6534ca9b28d0a003483d951 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:24.202385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28557266-2610-46ab-b985-643768f0f9ec None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:24.202898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28557266-2610-46ab-b985-643768f0f9ec None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:24.202898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28557266-2610-46ab-b985-643768f0f9ec None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:24.204808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 626/1247] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:24.209963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411045f-9940-497a-92a5-9089f82e4b89 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:24.212740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411045f-9940-497a-92a5-9089f82e4b89 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:24.212740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411045f-9940-497a-92a5-9089f82e4b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:24.215601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:24.228217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2411045f-9940-497a-92a5-9089f82e4b89 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:24.229388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2411045f-9940-497a-92a5-9089f82e4b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:24.293565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 622/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:24.317508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28557266-2610-46ab-b985-643768f0f9ec None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:24.336240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:24.418237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28557266-2610-46ab-b985-643768f0f9ec None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:24.453093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcdc36-47df-4d46-8cce-a95ce49583db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:24.454452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdc36-47df-4d46-8cce-a95ce49583db None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:24.454742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdc36-47df-4d46-8cce-a95ce49583db None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:24.455019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdc36-47df-4d46-8cce-a95ce49583db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:24.464966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcdc36-47df-4d46-8cce-a95ce49583db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-e8dcdc36-47df-4d46-8cce-a95ce49583db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:36:24.472932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:24.474869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:24.475899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 627/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:24.480265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411045f-9940-497a-92a5-9089f82e4b89 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:24.577131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411045f-9940-497a-92a5-9089f82e4b89 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:24.606135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:24.610811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc88e0-3982-4834-a8f5-dd3a74cb6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:24.611471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc88e0-3982-4834-a8f5-dd3a74cb6648 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:24.611757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc88e0-3982-4834-a8f5-dd3a74cb6648 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:24.612036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc88e0-3982-4834-a8f5-dd3a74cb6648 None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:24.612780 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc88e0-3982-4834-a8f5-dd3a74cb6648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:24.613088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc88e0-3982-4834-a8f5-dd3a74cb6648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:24.614680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc88e0-3982-4834-a8f5-dd3a74cb6648 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:24.622580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 623/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:24.628721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcdc36-47df-4d46-8cce-a95ce49583db None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:24.707052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:24.728755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcdc36-47df-4d46-8cce-a95ce49583db None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:24.760740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747c696-7ae0-4794-a8b7-75e00fb69525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:24.761518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747c696-7ae0-4794-a8b7-75e00fb69525 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:24.761810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747c696-7ae0-4794-a8b7-75e00fb69525 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:24.762110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747c696-7ae0-4794-a8b7-75e00fb69525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:24.773538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747c696-7ae0-4794-a8b7-75e00fb69525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:24.775023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747c696-7ae0-4794-a8b7-75e00fb69525 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-0747c696-7ae0-4794-a8b7-75e00fb69525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:24.791903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:24.793049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:24.794200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:24.794200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:24.794200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:24.794200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:24.794200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 628/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:24.799449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc88e0-3982-4834-a8f5-dd3a74cb6648 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:24.899598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc88e0-3982-4834-a8f5-dd3a74cb6648 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:24.936820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275ac40-8ac8-487d-9a74-9139e9c80ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:24.937477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275ac40-8ac8-487d-9a74-9139e9c80ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:24.937763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275ac40-8ac8-487d-9a74-9139e9c80ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:24.938620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275ac40-8ac8-487d-9a74-9139e9c80ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:24.939490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275ac40-8ac8-487d-9a74-9139e9c80ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:24.939794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275ac40-8ac8-487d-9a74-9139e9c80ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:24.941194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275ac40-8ac8-487d-9a74-9139e9c80ff6 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:24.953361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 624/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:24.964565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747c696-7ae0-4794-a8b7-75e00fb69525 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:25.063874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747c696-7ae0-4794-a8b7-75e00fb69525 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:25.090003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:25.098120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734c362-3613-4d04-8961-72225ce66304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:25.098916 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734c362-3613-4d04-8961-72225ce66304 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:25.099204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734c362-3613-4d04-8961-72225ce66304 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:25.099483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734c362-3613-4d04-8961-72225ce66304 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:25.106810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734c362-3613-4d04-8961-72225ce66304 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:25.108251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734c362-3613-4d04-8961-72225ce66304 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-3734c362-3613-4d04-8961-72225ce66304 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:36:25.122637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:25.123785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:25.124995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 629/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:25.130838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275ac40-8ac8-487d-9a74-9139e9c80ff6 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:25.185225 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:25.227612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275ac40-8ac8-487d-9a74-9139e9c80ff6 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:25.260187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203de7ef-ad5a-4077-93fd-dfa1b08260e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:25.260888 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203de7ef-ad5a-4077-93fd-dfa1b08260e2 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:25.261171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203de7ef-ad5a-4077-93fd-dfa1b08260e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:25.261446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203de7ef-ad5a-4077-93fd-dfa1b08260e2 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:25.262346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203de7ef-ad5a-4077-93fd-dfa1b08260e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:25.262655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203de7ef-ad5a-4077-93fd-dfa1b08260e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:25.264077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203de7ef-ad5a-4077-93fd-dfa1b08260e2 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:25.281348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 625/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 10:36:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:25.287710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734c362-3613-4d04-8961-72225ce66304 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:25.388465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734c362-3613-4d04-8961-72225ce66304 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:25.421104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13118c6d-b438-4b86-8953-31467d70daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:25.421741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13118c6d-b438-4b86-8953-31467d70daa3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:25.422058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13118c6d-b438-4b86-8953-31467d70daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:25.422940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13118c6d-b438-4b86-8953-31467d70daa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:25.476173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:25.489168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13118c6d-b438-4b86-8953-31467d70daa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:25.490606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13118c6d-b438-4b86-8953-31467d70daa3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:25.586458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 630/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:36:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:36:25.592383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203de7ef-ad5a-4077-93fd-dfa1b08260e2 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:25.689770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203de7ef-ad5a-4077-93fd-dfa1b08260e2 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:25.704124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:25.725058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91cdf4-6e92-4943-b7de-13ea929a63eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:25.725846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91cdf4-6e92-4943-b7de-13ea929a63eb None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:25.726166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91cdf4-6e92-4943-b7de-13ea929a63eb None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:25.726444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91cdf4-6e92-4943-b7de-13ea929a63eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:25.736076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91cdf4-6e92-4943-b7de-13ea929a63eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:25.737512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91cdf4-6e92-4943-b7de-13ea929a63eb None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-5a91cdf4-6e92-4943-b7de-13ea929a63eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:25.754734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:25.755808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:25.756824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:25.756824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:25.756824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:25.756824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:25.756824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 626/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:25.762125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13118c6d-b438-4b86-8953-31467d70daa3 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:25.850360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:25.862143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13118c6d-b438-4b86-8953-31467d70daa3 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:25.895471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66440a-b7d1-4d2c-b112-3b95371771e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:25.896138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66440a-b7d1-4d2c-b112-3b95371771e2 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:25.896427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66440a-b7d1-4d2c-b112-3b95371771e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:25.896709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66440a-b7d1-4d2c-b112-3b95371771e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:25.897431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66440a-b7d1-4d2c-b112-3b95371771e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:25.897742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66440a-b7d1-4d2c-b112-3b95371771e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:25.899182 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66440a-b7d1-4d2c-b112-3b95371771e2 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:25.911369 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 631/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:36:25.917059 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91cdf4-6e92-4943-b7de-13ea929a63eb None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:26.016784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91cdf4-6e92-4943-b7de-13ea929a63eb None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:26.050137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2870c-347d-4008-ad37-f28c4a718f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:26.050958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2870c-347d-4008-ad37-f28c4a718f30 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:26.051242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2870c-347d-4008-ad37-f28c4a718f30 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:26.051516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2870c-347d-4008-ad37-f28c4a718f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:26.058058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2870c-347d-4008-ad37-f28c4a718f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:26.060333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2870c-347d-4008-ad37-f28c4a718f30 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-cce2870c-347d-4008-ad37-f28c4a718f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:36:26.072963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:26.073834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:26.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:36:26.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:36:26.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:36:26.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:36:26.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:36:26.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:36:26.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:26.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:26.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 627/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:26.080640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66440a-b7d1-4d2c-b112-3b95371771e2 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:26.180457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66440a-b7d1-4d2c-b112-3b95371771e2 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:26.213100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652537b4-0248-4d44-bb48-9c4ea1b68e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:26.215075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652537b4-0248-4d44-bb48-9c4ea1b68e2e None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:26.215075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652537b4-0248-4d44-bb48-9c4ea1b68e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:26.215075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652537b4-0248-4d44-bb48-9c4ea1b68e2e None admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:26.215318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652537b4-0248-4d44-bb48-9c4ea1b68e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:26.215401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652537b4-0248-4d44-bb48-9c4ea1b68e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:26.216838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652537b4-0248-4d44-bb48-9c4ea1b68e2e None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:26.229596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 632/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:26.236278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2870c-347d-4008-ad37-f28c4a718f30 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:26.261533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:26.333089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2870c-347d-4008-ad37-f28c4a718f30 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:26.369222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd50741-a48b-4198-af9c-88d42dd3e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:26.369866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd50741-a48b-4198-af9c-88d42dd3e6a8 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:26.370178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd50741-a48b-4198-af9c-88d42dd3e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:26.370556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd50741-a48b-4198-af9c-88d42dd3e6a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:26.371383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd50741-a48b-4198-af9c-88d42dd3e6a8 None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=3238a52a3f6047e0acb0136ab39257e8) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:26.371695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd50741-a48b-4198-af9c-88d42dd3e6a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:26.373114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd50741-a48b-4198-af9c-88d42dd3e6a8 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:26.378644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 628/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:36:26 2022] GET /identity/v3/role_assignments?user.id=3238a52a3f6047e0acb0136ab39257e8&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:28.385013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9e6d1-c30e-4bf2-b6ce-dbafa0ab8b46 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:28.385571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9e6d1-c30e-4bf2-b6ce-dbafa0ab8b46 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:28.385571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9e6d1-c30e-4bf2-b6ce-dbafa0ab8b46 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:28.387139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 633/1261] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:28.392363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c00eb-e8ab-42d7-9673-f6435d9f1b6d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:28.392812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c00eb-e8ab-42d7-9673-f6435d9f1b6d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:28.392917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c00eb-e8ab-42d7-9673-f6435d9f1b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:28.410138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-d94c00eb-e8ab-42d7-9673-f6435d9f1b6d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:28.411506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d94c00eb-e8ab-42d7-9673-f6435d9f1b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:28.478893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 629/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:28.502132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9e6d1-c30e-4bf2-b6ce-dbafa0ab8b46 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:28.513064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:28.603177 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9e6d1-c30e-4bf2-b6ce-dbafa0ab8b46 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:28.638415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a157182-3c48-4e78-a14c-eb62de35cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:28.638878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a157182-3c48-4e78-a14c-eb62de35cca4 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:28.639160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a157182-3c48-4e78-a14c-eb62de35cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:28.639434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a157182-3c48-4e78-a14c-eb62de35cca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:28.649690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a157182-3c48-4e78-a14c-eb62de35cca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-1a157182-3c48-4e78-a14c-eb62de35cca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:36:28.657800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:28.658974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:28.660230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 634/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:36:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:28.665131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c00eb-e8ab-42d7-9673-f6435d9f1b6d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:28.683351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:28.763883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c00eb-e8ab-42d7-9673-f6435d9f1b6d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:28.797851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9eeee-b29f-4640-bef9-f238e1f9746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:28.798559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9eeee-b29f-4640-bef9-f238e1f9746f None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:28.798847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9eeee-b29f-4640-bef9-f238e1f9746f None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:28.799126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9eeee-b29f-4640-bef9-f238e1f9746f None admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:28.799911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9eeee-b29f-4640-bef9-f238e1f9746f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:28.800220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9eeee-b29f-4640-bef9-f238e1f9746f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:28.801589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9eeee-b29f-4640-bef9-f238e1f9746f None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:28.809738 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 630/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:36:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:28.815547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a157182-3c48-4e78-a14c-eb62de35cca4 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:28.882229 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:28.915692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a157182-3c48-4e78-a14c-eb62de35cca4 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:28.948711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7309-a06c-459d-a334-26f790bc2077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:28.949498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7309-a06c-459d-a334-26f790bc2077 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:28.949784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7309-a06c-459d-a334-26f790bc2077 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:28.950098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7309-a06c-459d-a334-26f790bc2077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:28.960978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf7309-a06c-459d-a334-26f790bc2077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:28.962483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf7309-a06c-459d-a334-26f790bc2077 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-98bf7309-a06c-459d-a334-26f790bc2077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:28.979600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:28.982257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:28.983144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:28.983144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:28.983144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:28.983144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:28.983144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 635/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:28.986765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9eeee-b29f-4640-bef9-f238e1f9746f None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:29.067315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:29.086391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9eeee-b29f-4640-bef9-f238e1f9746f None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:29.118906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3485caf-10c1-4b5d-884d-d74618768863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:29.119563 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485caf-10c1-4b5d-884d-d74618768863 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:29.119852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485caf-10c1-4b5d-884d-d74618768863 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:29.120169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485caf-10c1-4b5d-884d-d74618768863 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:29.120891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3485caf-10c1-4b5d-884d-d74618768863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:29.121200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3485caf-10c1-4b5d-884d-d74618768863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:29.122660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3485caf-10c1-4b5d-884d-d74618768863 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:29.135662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 631/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:29.142118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7309-a06c-459d-a334-26f790bc2077 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:29.241990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7309-a06c-459d-a334-26f790bc2077 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:29.261635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:29.275820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a388022-22de-422a-9c6f-ca04fcc0970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:29.276611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a388022-22de-422a-9c6f-ca04fcc0970d None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:29.276893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a388022-22de-422a-9c6f-ca04fcc0970d None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:29.277169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a388022-22de-422a-9c6f-ca04fcc0970d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:29.284430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a388022-22de-422a-9c6f-ca04fcc0970d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:29.285865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a388022-22de-422a-9c6f-ca04fcc0970d None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-9a388022-22de-422a-9c6f-ca04fcc0970d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:36:29.301321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:29.302285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:29.303678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 636/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:29.308372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3485caf-10c1-4b5d-884d-d74618768863 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:29.407357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3485caf-10c1-4b5d-884d-d74618768863 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:29.440950 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd459-0fad-41c7-b2ec-0f38f6e5c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:29.441618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd459-0fad-41c7-b2ec-0f38f6e5c203 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:29.441902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd459-0fad-41c7-b2ec-0f38f6e5c203 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:29.442217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd459-0fad-41c7-b2ec-0f38f6e5c203 None admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:29.443054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd459-0fad-41c7-b2ec-0f38f6e5c203 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:29.443369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd459-0fad-41c7-b2ec-0f38f6e5c203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:29.444838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd459-0fad-41c7-b2ec-0f38f6e5c203 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:29.453446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:29.461703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 632/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 10:36:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:29.467521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a388022-22de-422a-9c6f-ca04fcc0970d None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:29.568733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a388022-22de-422a-9c6f-ca04fcc0970d None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:29.604906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c352a-42e9-4796-ac4c-d6320f918b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:29.605731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c352a-42e9-4796-ac4c-d6320f918b3a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:29.606017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c352a-42e9-4796-ac4c-d6320f918b3a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:29.606303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c352a-42e9-4796-ac4c-d6320f918b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:29.618620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c352a-42e9-4796-ac4c-d6320f918b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:29.620084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c352a-42e9-4796-ac4c-d6320f918b3a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-066c352a-42e9-4796-ac4c-d6320f918b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:29.637723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:29.638908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:29.640196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:29.640196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:29.640196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:29.640196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:29.640196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 637/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:29.644742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd459-0fad-41c7-b2ec-0f38f6e5c203 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:29.742998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd459-0fad-41c7-b2ec-0f38f6e5c203 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:29.775823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6d1e-568d-466b-abb4-c79f58a94041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:29.776478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6d1e-568d-466b-abb4-c79f58a94041 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:29.776769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6d1e-568d-466b-abb4-c79f58a94041 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:29.777049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6d1e-568d-466b-abb4-c79f58a94041 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:29.777768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6d1e-568d-466b-abb4-c79f58a94041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:29.778109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6d1e-568d-466b-abb4-c79f58a94041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:29.779475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6d1e-568d-466b-abb4-c79f58a94041 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:29.791145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 633/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:29.796776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c352a-42e9-4796-ac4c-d6320f918b3a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:29.828395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:29.903511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c352a-42e9-4796-ac4c-d6320f918b3a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:29.945100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669d77f-0f3d-4b12-8bed-8b8b9dbfb34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:29.946323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669d77f-0f3d-4b12-8bed-8b8b9dbfb34a None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:29.946762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669d77f-0f3d-4b12-8bed-8b8b9dbfb34a None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:29.947193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669d77f-0f3d-4b12-8bed-8b8b9dbfb34a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:29.956908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669d77f-0f3d-4b12-8bed-8b8b9dbfb34a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:29.959225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669d77f-0f3d-4b12-8bed-8b8b9dbfb34a None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-2669d77f-0f3d-4b12-8bed-8b8b9dbfb34a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:36:29.977704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:29.978832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:29.980051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:36:29.980051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:36:29.980051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:36:29.980051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:36:29.980051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:36:29.980051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:36:29.980051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:29.980051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:29.980051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 638/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:29.985359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6d1e-568d-466b-abb4-c79f58a94041 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:30.043275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:30.088779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6d1e-568d-466b-abb4-c79f58a94041 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:30.121481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94402b4a-90cb-49e9-8633-49d1d7e1b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:30.122229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402b4a-90cb-49e9-8633-49d1d7e1b95c None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:30.122517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402b4a-90cb-49e9-8633-49d1d7e1b95c None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:30.122793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402b4a-90cb-49e9-8633-49d1d7e1b95c None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:30.123576 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402b4a-90cb-49e9-8633-49d1d7e1b95c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:30.123890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402b4a-90cb-49e9-8633-49d1d7e1b95c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:30.125335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402b4a-90cb-49e9-8633-49d1d7e1b95c None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:30.138041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 634/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:30.144688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669d77f-0f3d-4b12-8bed-8b8b9dbfb34a None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:30.236562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:30.245141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669d77f-0f3d-4b12-8bed-8b8b9dbfb34a None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:30.279711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53912f-351a-4ed7-82ad-3c288d531a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:30.280609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53912f-351a-4ed7-82ad-3c288d531a9c None admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:30.280893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53912f-351a-4ed7-82ad-3c288d531a9c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:30.281233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53912f-351a-4ed7-82ad-3c288d531a9c None admin] PATH_INFO: `/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/3238a52a3f6047e0acb0136ab39257e8/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:30.283810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53912f-351a-4ed7-82ad-3c288d531a9c None admin] RBAC: Authorizing `identity:create_grant(project_id=2e4056fccf08430b87e2e8cf1aa1c60f, user_id=3238a52a3f6047e0acb0136ab39257e8, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:30.285252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53912f-351a-4ed7-82ad-3c288d531a9c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:30.354241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 639/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jun 30 10:36:30 2022] PUT /identity/v3/projects/2e4056fccf08430b87e2e8cf1aa1c60f/users/3238a52a3f6047e0acb0136ab39257e8/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:36:32.371456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b743fe-3f21-477a-830c-c588d0575c91 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:32.372008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b743fe-3f21-477a-830c-c588d0575c91 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:32.372008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b743fe-3f21-477a-830c-c588d0575c91 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:32.373375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 635/1274] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:32.379028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc2ed1-3b95-4177-93f4-f2932be02f33 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:32.379404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc2ed1-3b95-4177-93f4-f2932be02f33 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:32.379587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc2ed1-3b95-4177-93f4-f2932be02f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:32.395614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-91dc2ed1-3b95-4177-93f4-f2932be02f33 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:32.396827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-91dc2ed1-3b95-4177-93f4-f2932be02f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:32.462744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 640/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:32.487046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b743fe-3f21-477a-830c-c588d0575c91 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:32.585638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b743fe-3f21-477a-830c-c588d0575c91 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:32.604514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:32.621235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40f81c-d08c-4a25-b6d3-aceec1cc6653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:32.622089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40f81c-d08c-4a25-b6d3-aceec1cc6653 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:32.622325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40f81c-d08c-4a25-b6d3-aceec1cc6653 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:32.622597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40f81c-d08c-4a25-b6d3-aceec1cc6653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:32.632936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40f81c-d08c-4a25-b6d3-aceec1cc6653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-fd40f81c-d08c-4a25-b6d3-aceec1cc6653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:36:32.640459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:32.641582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:32.642659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 636/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jun 30 10:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:32.647725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc2ed1-3b95-4177-93f4-f2932be02f33 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:32.728424 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:32.746350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc2ed1-3b95-4177-93f4-f2932be02f33 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:32.778455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbd718-3286-4b37-93d2-53523dc3413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:32.779157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd718-3286-4b37-93d2-53523dc3413c None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:32.779437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd718-3286-4b37-93d2-53523dc3413c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:32.779714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd718-3286-4b37-93d2-53523dc3413c None admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:32.780453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbd718-3286-4b37-93d2-53523dc3413c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:32.780762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbd718-3286-4b37-93d2-53523dc3413c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:32.782705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbd718-3286-4b37-93d2-53523dc3413c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:32.790773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 641/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jun 30 10:36:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:32.796339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40f81c-d08c-4a25-b6d3-aceec1cc6653 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:32.895766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40f81c-d08c-4a25-b6d3-aceec1cc6653 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:32.929572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256010f-9e7d-4b50-8de1-348728ff9cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:32.930388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256010f-9e7d-4b50-8de1-348728ff9cea None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:32.930676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256010f-9e7d-4b50-8de1-348728ff9cea None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:32.930954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256010f-9e7d-4b50-8de1-348728ff9cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:32.941467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256010f-9e7d-4b50-8de1-348728ff9cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:32.942929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256010f-9e7d-4b50-8de1-348728ff9cea None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-e256010f-9e7d-4b50-8de1-348728ff9cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:32.959473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:32.962316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:32.963421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:32.963421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:32.963421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:32.963421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:32.963421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 637/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:36:32.966494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbd718-3286-4b37-93d2-53523dc3413c None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:33.064302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbd718-3286-4b37-93d2-53523dc3413c None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:33.097679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275245-390c-485b-b049-175cf9e5eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:33.098357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275245-390c-485b-b049-175cf9e5eb78 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:33.098642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275245-390c-485b-b049-175cf9e5eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:33.098917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275245-390c-485b-b049-175cf9e5eb78 None admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:33.099632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275245-390c-485b-b049-175cf9e5eb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:33.099940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275245-390c-485b-b049-175cf9e5eb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:33.101305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275245-390c-485b-b049-175cf9e5eb78 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:33.113411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 642/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:33.119204 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256010f-9e7d-4b50-8de1-348728ff9cea None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:33.149757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:33.220183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256010f-9e7d-4b50-8de1-348728ff9cea None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:33.252803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbe7e1-f141-49a8-a162-9d88e43c1d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:33.253599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbe7e1-f141-49a8-a162-9d88e43c1d9e None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:33.253889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbe7e1-f141-49a8-a162-9d88e43c1d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:33.254270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbe7e1-f141-49a8-a162-9d88e43c1d9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:33.261795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbe7e1-f141-49a8-a162-9d88e43c1d9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:33.263268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbe7e1-f141-49a8-a162-9d88e43c1d9e None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-58bbe7e1-f141-49a8-a162-9d88e43c1d9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:36:33.277731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:33.278840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:33.280245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 638/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:33.285452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275245-390c-485b-b049-175cf9e5eb78 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:33.289233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:33.381327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275245-390c-485b-b049-175cf9e5eb78 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:33.416235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150eda64-f6dd-4363-ab74-0457e60c5a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:33.416841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eda64-f6dd-4363-ab74-0457e60c5a64 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:33.417127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eda64-f6dd-4363-ab74-0457e60c5a64 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:33.417408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eda64-f6dd-4363-ab74-0457e60c5a64 None admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:33.418290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150eda64-f6dd-4363-ab74-0457e60c5a64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:33.418620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150eda64-f6dd-4363-ab74-0457e60c5a64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:33.420050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150eda64-f6dd-4363-ab74-0457e60c5a64 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:33.436877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 643/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jun 30 10:36:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:33.443089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbe7e1-f141-49a8-a162-9d88e43c1d9e None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:33.530083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:33.539076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbe7e1-f141-49a8-a162-9d88e43c1d9e None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:33.570523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9a77e-b96d-448a-b4f5-377d33ca84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:33.571157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9a77e-b96d-448a-b4f5-377d33ca84f1 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:33.571439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9a77e-b96d-448a-b4f5-377d33ca84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:33.571713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9a77e-b96d-448a-b4f5-377d33ca84f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:33.638046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9a77e-b96d-448a-b4f5-377d33ca84f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:33.639485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9a77e-b96d-448a-b4f5-377d33ca84f1 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:33.725688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:33.736321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 639/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jun 30 10:36:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:36:33.742177 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150eda64-f6dd-4363-ab74-0457e60c5a64 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:33.805890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:33.842313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150eda64-f6dd-4363-ab74-0457e60c5a64 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:33.882478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25031-bc03-463b-8be2-89d19f92b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:33.883300 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25031-bc03-463b-8be2-89d19f92b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:33.883583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25031-bc03-463b-8be2-89d19f92b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:33.883855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25031-bc03-463b-8be2-89d19f92b4e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:33.895162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f25031-bc03-463b-8be2-89d19f92b4e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:33.896641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f25031-bc03-463b-8be2-89d19f92b4e4 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-b0f25031-bc03-463b-8be2-89d19f92b4e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:36:33.914796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:33.915941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:33.917033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:36:33.917033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:36:33.917033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:36:33.917033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:33.917033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 644/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:33.921703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9a77e-b96d-448a-b4f5-377d33ca84f1 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:34.018587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9a77e-b96d-448a-b4f5-377d33ca84f1 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:34.051834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652919f-669c-45fc-93c6-74c28759ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:34.052506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652919f-669c-45fc-93c6-74c28759ff00 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:34.052792 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652919f-669c-45fc-93c6-74c28759ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:34.053075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652919f-669c-45fc-93c6-74c28759ff00 None admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:34.053800 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652919f-669c-45fc-93c6-74c28759ff00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:34.054149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652919f-669c-45fc-93c6-74c28759ff00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:34.055521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652919f-669c-45fc-93c6-74c28759ff00 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:34.067347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 640/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jun 30 10:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:34.073143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25031-bc03-463b-8be2-89d19f92b4e4 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:34.172226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25031-bc03-463b-8be2-89d19f92b4e4 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:34.185917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:34.205196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df97fdc-85c8-4e55-9614-6fdcd172b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:34.206003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df97fdc-85c8-4e55-9614-6fdcd172b88b None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:34.206291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df97fdc-85c8-4e55-9614-6fdcd172b88b None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:34.206570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df97fdc-85c8-4e55-9614-6fdcd172b88b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:34.213106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df97fdc-85c8-4e55-9614-6fdcd172b88b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:34.214605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df97fdc-85c8-4e55-9614-6fdcd172b88b None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application [None req-2df97fdc-85c8-4e55-9614-6fdcd172b88b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:36:34.229678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:34.233825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:34.235518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:36:34.235518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:36:34.235518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:36:34.235518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:36:34.235518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:36:34.235518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:36:34.235518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:36:34.235518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: ERROR keystone.server.flask.application Jun 30 10:36:34.235518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 645/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jun 30 10:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:34.237203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652919f-669c-45fc-93c6-74c28759ff00 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:34.286584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:34.334109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652919f-669c-45fc-93c6-74c28759ff00 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:34.366995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78e9df-3307-47bd-951c-41ac19dc56ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:34.367642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78e9df-3307-47bd-951c-41ac19dc56ec None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:34.367924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78e9df-3307-47bd-951c-41ac19dc56ec None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:34.368199 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78e9df-3307-47bd-951c-41ac19dc56ec None admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:34.368977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78e9df-3307-47bd-951c-41ac19dc56ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:34.369285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78e9df-3307-47bd-951c-41ac19dc56ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:34.370763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78e9df-3307-47bd-951c-41ac19dc56ec None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:34.383477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 641/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jun 30 10:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:34.389498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df97fdc-85c8-4e55-9614-6fdcd172b88b None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:34.493786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df97fdc-85c8-4e55-9614-6fdcd172b88b None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:34.531273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5c3ae-66c6-4427-a098-ad3fa89f8fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:34.531949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5c3ae-66c6-4427-a098-ad3fa89f8fef None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:34.532237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5c3ae-66c6-4427-a098-ad3fa89f8fef None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:34.532510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5c3ae-66c6-4427-a098-ad3fa89f8fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:34.533411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5c3ae-66c6-4427-a098-ad3fa89f8fef None admin] RBAC: Adding query filter params (role.id=d1911a6ba3474c3698626857c3bbb1f7, scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f, user.id=3238a52a3f6047e0acb0136ab39257e8) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:34.533729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5c3ae-66c6-4427-a098-ad3fa89f8fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:34.535320 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5c3ae-66c6-4427-a098-ad3fa89f8fef None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:34.542289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 646/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jun 30 10:36:34 2022] GET /identity/v3/role_assignments?user.id=3238a52a3f6047e0acb0136ab39257e8&scope.project.id=2e4056fccf08430b87e2e8cf1aa1c60f&role.id=d1911a6ba3474c3698626857c3bbb1f7 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:36.612653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2a15-2cd9-45d3-b349-1b6c09e28e4a None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:36.613203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2a15-2cd9-45d3-b349-1b6c09e28e4a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:36.613203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2a15-2cd9-45d3-b349-1b6c09e28e4a None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:36.614651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 642/1288] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:36.619750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb9107-1499-4a34-8c02-15214bf3dce5 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:36.620187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb9107-1499-4a34-8c02-15214bf3dce5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:36.620307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb9107-1499-4a34-8c02-15214bf3dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:36.637605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4fdb9107-1499-4a34-8c02-15214bf3dce5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:36.638920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4fdb9107-1499-4a34-8c02-15214bf3dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:36.668452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:36.706138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 647/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:36.729005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc2a15-2cd9-45d3-b349-1b6c09e28e4a None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:36.828288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc2a15-2cd9-45d3-b349-1b6c09e28e4a None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:36.838784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:36.861453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce39d8-f8b6-4fc5-ad39-30556cde65a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:36.862272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce39d8-f8b6-4fc5-ad39-30556cde65a4 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:36.862559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce39d8-f8b6-4fc5-ad39-30556cde65a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:36.862885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce39d8-f8b6-4fc5-ad39-30556cde65a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:36.863491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce39d8-f8b6-4fc5-ad39-30556cde65a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:36.864868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce39d8-f8b6-4fc5-ad39-30556cde65a4 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-26ce39d8-f8b6-4fc5-ad39-30556cde65a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:36.876413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:36.877473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:36.878472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 643/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:36:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:36.883487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb9107-1499-4a34-8c02-15214bf3dce5 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:36.983656 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb9107-1499-4a34-8c02-15214bf3dce5 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:37.017360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997456-2cd7-4687-8a22-655d51fd71c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:37.018046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997456-2cd7-4687-8a22-655d51fd71c3 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:37.018337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997456-2cd7-4687-8a22-655d51fd71c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:37.018620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997456-2cd7-4687-8a22-655d51fd71c3 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:37.019326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997456-2cd7-4687-8a22-655d51fd71c3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:37.019640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997456-2cd7-4687-8a22-655d51fd71c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:37.021026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997456-2cd7-4687-8a22-655d51fd71c3 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:37.025840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 648/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 30 10:36:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:37.032279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce39d8-f8b6-4fc5-ad39-30556cde65a4 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:37.130902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce39d8-f8b6-4fc5-ad39-30556cde65a4 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:37.163289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c212354-3045-4ac6-9877-375f4ee398db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:37.163934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c212354-3045-4ac6-9877-375f4ee398db None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:37.164241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c212354-3045-4ac6-9877-375f4ee398db None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:37.164496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c212354-3045-4ac6-9877-375f4ee398db None admin] PATH_INFO: `/v3/services` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:37.165197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c212354-3045-4ac6-9877-375f4ee398db None admin] RBAC: Adding query filter params (type=placement) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:37.165502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c212354-3045-4ac6-9877-375f4ee398db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:37.166887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c212354-3045-4ac6-9877-375f4ee398db None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:37.173134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 644/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 30 10:36:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:39.179439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf7e6-92ac-4503-9104-ffad88612e29 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:39.180006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf7e6-92ac-4503-9104-ffad88612e29 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:39.180006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf7e6-92ac-4503-9104-ffad88612e29 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:39.181422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 649/1293] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:39.186612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf256f-709c-4e6a-aa63-9c03a1905c76 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:39.187031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf256f-709c-4e6a-aa63-9c03a1905c76 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:39.187210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf256f-709c-4e6a-aa63-9c03a1905c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:39.204147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b7bf256f-709c-4e6a-aa63-9c03a1905c76 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:39.205318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b7bf256f-709c-4e6a-aa63-9c03a1905c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:39.234928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:39.270530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 645/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:39.293875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbf7e6-92ac-4503-9104-ffad88612e29 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:39.324167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:39.394247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbf7e6-92ac-4503-9104-ffad88612e29 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:39.427881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca452ef9-1d55-4910-af3d-0c31eb82e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:39.428544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca452ef9-1d55-4910-af3d-0c31eb82e87c None admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:39.428832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca452ef9-1d55-4910-af3d-0c31eb82e87c None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:39.429113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca452ef9-1d55-4910-af3d-0c31eb82e87c None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:39.429895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca452ef9-1d55-4910-af3d-0c31eb82e87c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:39.431272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca452ef9-1d55-4910-af3d-0c31eb82e87c None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:39.503665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 650/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jun 30 10:36:39 2022] POST /identity/v3/services => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:36:41.535709 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011cd79-24d2-4c2b-90c3-8f516f5625e7 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:41.536243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011cd79-24d2-4c2b-90c3-8f516f5625e7 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:41.536243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011cd79-24d2-4c2b-90c3-8f516f5625e7 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:41.537633 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 646/1296] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:36:41.542841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f53b1-34c6-440d-b595-45ce0996ca82 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:41.543278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f53b1-34c6-440d-b595-45ce0996ca82 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:41.543406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f53b1-34c6-440d-b595-45ce0996ca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:41.559897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b98f53b1-34c6-440d-b595-45ce0996ca82 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:41.561062 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b98f53b1-34c6-440d-b595-45ce0996ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:41.638543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 651/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:41.662444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011cd79-24d2-4c2b-90c3-8f516f5625e7 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:41.760293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011cd79-24d2-4c2b-90c3-8f516f5625e7 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:41.793813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5792bb9-a811-4260-8f5d-98fc4ce1ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:41.794636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5792bb9-a811-4260-8f5d-98fc4ce1ab54 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:41.794963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5792bb9-a811-4260-8f5d-98fc4ce1ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:41.795245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5792bb9-a811-4260-8f5d-98fc4ce1ab54 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:41.795903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5792bb9-a811-4260-8f5d-98fc4ce1ab54 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:41.797299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5792bb9-a811-4260-8f5d-98fc4ce1ab54 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-c5792bb9-a811-4260-8f5d-98fc4ce1ab54 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:41.808992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:41.810192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:41.811345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 647/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:36:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:41.816782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f53b1-34c6-440d-b595-45ce0996ca82 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:41.835485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:41.915097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f53b1-34c6-440d-b595-45ce0996ca82 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:41.948511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5ed2-a739-4ca4-9e6e-ff9b65578a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:41.949168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5ed2-a739-4ca4-9e6e-ff9b65578a83 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:41.949520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5ed2-a739-4ca4-9e6e-ff9b65578a83 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:41.949850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5ed2-a739-4ca4-9e6e-ff9b65578a83 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:41.950588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c5ed2-a739-4ca4-9e6e-ff9b65578a83 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:41.950898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c5ed2-a739-4ca4-9e6e-ff9b65578a83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:41.952274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c5ed2-a739-4ca4-9e6e-ff9b65578a83 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:41.957987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 652/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 30 10:36:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:41.963963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5792bb9-a811-4260-8f5d-98fc4ce1ab54 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:41.995253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:42.069175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5792bb9-a811-4260-8f5d-98fc4ce1ab54 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:42.102157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c84f5-be4a-48ac-a939-832841af1011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:42.102811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c84f5-be4a-48ac-a939-832841af1011 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:42.103099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c84f5-be4a-48ac-a939-832841af1011 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:42.103376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c84f5-be4a-48ac-a939-832841af1011 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:42.104164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c84f5-be4a-48ac-a939-832841af1011 None admin] RBAC: Adding query filter params (interface=public, service_id=8ce8229d8abe443e9997ef8e572fee8d, region_id=RegionOne) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:42.104479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c84f5-be4a-48ac-a939-832841af1011 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:42.105852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c84f5-be4a-48ac-a939-832841af1011 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:42.111410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 648/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jun 30 10:36:41 2022] GET /identity/v3/endpoints?service_id=8ce8229d8abe443e9997ef8e572fee8d&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:42.117163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5ed2-a739-4ca4-9e6e-ff9b65578a83 None admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:42.197805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:42.215324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5ed2-a739-4ca4-9e6e-ff9b65578a83 None admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:42.248800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d2547-b4d3-4c6a-be70-ca8677d53f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:42.250104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d2547-b4d3-4c6a-be70-ca8677d53f6f None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:42.250415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d2547-b4d3-4c6a-be70-ca8677d53f6f None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:42.250679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d2547-b4d3-4c6a-be70-ca8677d53f6f None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:42.251359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d2547-b4d3-4c6a-be70-ca8677d53f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:42.252770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d2547-b4d3-4c6a-be70-ca8677d53f6f None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:42.259406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 653/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jun 30 10:36:42 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:36:44.279959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3f9db-e961-49f9-81af-fde9f51fb1bd None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:44.280976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3f9db-e961-49f9-81af-fde9f51fb1bd None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:44.280976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3f9db-e961-49f9-81af-fde9f51fb1bd None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:44.282388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 649/1302] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:44.287586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96482a-689c-48f0-ab21-4ac9d44f89a6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:44.288009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96482a-689c-48f0-ab21-4ac9d44f89a6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:44.288157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96482a-689c-48f0-ab21-4ac9d44f89a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:44.304874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-8f96482a-689c-48f0-ab21-4ac9d44f89a6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:44.306100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8f96482a-689c-48f0-ab21-4ac9d44f89a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:44.372782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 654/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:36:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:36:44.396195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3f9db-e961-49f9-81af-fde9f51fb1bd None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:44.491948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:44.498460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3f9db-e961-49f9-81af-fde9f51fb1bd None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:44.531630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45744add-00d0-4550-94f2-7247b5e14b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:44.532355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45744add-00d0-4550-94f2-7247b5e14b16 None admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:44.532645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45744add-00d0-4550-94f2-7247b5e14b16 None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:44.532928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45744add-00d0-4550-94f2-7247b5e14b16 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:44.533583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45744add-00d0-4550-94f2-7247b5e14b16 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:44.535024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45744add-00d0-4550-94f2-7247b5e14b16 None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application [None req-45744add-00d0-4550-94f2-7247b5e14b16 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:36:44.546611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:36:44.547621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application with Lock( Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: ERROR keystone.server.flask.application Jun 30 10:36:44.548550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 650/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jun 30 10:36:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:36:44.553838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96482a-689c-48f0-ab21-4ac9d44f89a6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:44.628760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:44.651570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96482a-689c-48f0-ab21-4ac9d44f89a6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:44.684839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3463bb-acb0-46fc-94f0-c4a09d53dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:44.685494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3463bb-acb0-46fc-94f0-c4a09d53dc51 None admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:44.685816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3463bb-acb0-46fc-94f0-c4a09d53dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:44.686124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3463bb-acb0-46fc-94f0-c4a09d53dc51 None admin] PATH_INFO: `/v3/services` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:44.687464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3463bb-acb0-46fc-94f0-c4a09d53dc51 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:44.687779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3463bb-acb0-46fc-94f0-c4a09d53dc51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:44.689160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3463bb-acb0-46fc-94f0-c4a09d53dc51 None admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:44.694430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 655/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jun 30 10:36:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:44.700205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45744add-00d0-4550-94f2-7247b5e14b16 None admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:44.797103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45744add-00d0-4550-94f2-7247b5e14b16 None admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:44.830209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf502-2e4a-441d-a798-1272390e09cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:44.830854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf502-2e4a-441d-a798-1272390e09cc None admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:44.831158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf502-2e4a-441d-a798-1272390e09cc None admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:44.831412 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf502-2e4a-441d-a798-1272390e09cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:44.832141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf502-2e4a-441d-a798-1272390e09cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:44.833497 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf502-2e4a-441d-a798-1272390e09cc None admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:44.922665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 651/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jun 30 10:36:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:36:54.691296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=30 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:54.918031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:41.340290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80415-c613-4923-97bf-4abcb0845626 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:41.340774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80415-c613-4923-97bf-4abcb0845626 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:41.341053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80415-c613-4923-97bf-4abcb0845626 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:41.348326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591278aa-85e5-4746-b2a1-93e8fb5c0565 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:41.348696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591278aa-85e5-4746-b2a1-93e8fb5c0565 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:41.348773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591278aa-85e5-4746-b2a1-93e8fb5c0565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:41.352415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 656/1307] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:42:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:42:41.444293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-591278aa-85e5-4746-b2a1-93e8fb5c0565 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:41.445544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-591278aa-85e5-4746-b2a1-93e8fb5c0565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:41.584530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 652/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:42:41.614897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a27a14-70c0-49da-9c71-6ad584bc2656 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:41.615195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a27a14-70c0-49da-9c71-6ad584bc2656 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:41.615659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a27a14-70c0-49da-9c71-6ad584bc2656 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:41.617239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 657/1309] 10.222.0.26 () {54 vars in 964 bytes} [Thu Jun 30 10:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:42:41.623846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0d793-837b-4cf2-96b6-18ad42fbcefc None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:41.624476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0d793-837b-4cf2-96b6-18ad42fbcefc None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:41.624968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0d793-837b-4cf2-96b6-18ad42fbcefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:41.712999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-efd0d793-837b-4cf2-96b6-18ad42fbcefc None None] MFA Rules not processed for user `719afb6dcb154119beb18d2f1974fe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:41.714157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-efd0d793-837b-4cf2-96b6-18ad42fbcefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:41.740198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:41.796970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 653/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Jun 30 10:42:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:41.806310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a27a14-70c0-49da-9c71-6ad584bc2656 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:41.808031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e3a27a14-70c0-49da-9c71-6ad584bc2656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:42.068729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a27a14-70c0-49da-9c71-6ad584bc2656 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:42.068729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6f3e5-c1cc-49eb-9740-55c5fff2389b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:42.068729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6f3e5-c1cc-49eb-9740-55c5fff2389b service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:42.068729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6f3e5-c1cc-49eb-9740-55c5fff2389b service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:42.069169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6f3e5-c1cc-49eb-9740-55c5fff2389b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:42.069169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d9f6f3e5-c1cc-49eb-9740-55c5fff2389b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:42.087618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:42.145392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6f3e5-c1cc-49eb-9740-55c5fff2389b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:42.146906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6f3e5-c1cc-49eb-9740-55c5fff2389b service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:42.167011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 658/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:44.474920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee6ba3-5fff-42d1-a880-445298c9d90d None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:44.475455 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee6ba3-5fff-42d1-a880-445298c9d90d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:44.475455 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee6ba3-5fff-42d1-a880-445298c9d90d None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:44.477199 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 654/1312] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:42:44.482548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3e826-3538-4496-ae4b-6821c843b2c8 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:44.482958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3e826-3538-4496-ae4b-6821c843b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:44.483118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3e826-3538-4496-ae4b-6821c843b2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:44.555227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c2a3e826-3538-4496-ae4b-6821c843b2c8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:44.556465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c2a3e826-3538-4496-ae4b-6821c843b2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:44.662745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 659/1313] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:44.700801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee6ba3-5fff-42d1-a880-445298c9d90d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:44.702440 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f5ee6ba3-5fff-42d1-a880-445298c9d90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:44.805446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee6ba3-5fff-42d1-a880-445298c9d90d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:44.877873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:44.880271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cf14d-0b9f-48f6-b567-a6e5e63bcd51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:44.880919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cf14d-0b9f-48f6-b567-a6e5e63bcd51 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:44.881206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cf14d-0b9f-48f6-b567-a6e5e63bcd51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:44.881485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cf14d-0b9f-48f6-b567-a6e5e63bcd51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:44.883141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1b2cf14d-0b9f-48f6-b567-a6e5e63bcd51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:44.998355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cf14d-0b9f-48f6-b567-a6e5e63bcd51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:44.999797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cf14d-0b9f-48f6-b567-a6e5e63bcd51 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:45.017752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 655/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:47.609070 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5568-a4fe-4ae5-bfbc-0acaa600675c None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:47.609597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5568-a4fe-4ae5-bfbc-0acaa600675c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:47.609720 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5568-a4fe-4ae5-bfbc-0acaa600675c None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:47.611212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 660/1315] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:42:47.616207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7cbf5-c045-4f95-b66f-a60f11868f8a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:47.616634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7cbf5-c045-4f95-b66f-a60f11868f8a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:47.616791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7cbf5-c045-4f95-b66f-a60f11868f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:47.683349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-57d7cbf5-c045-4f95-b66f-a60f11868f8a None None] MFA Rules not processed for user `5b58537fcdd84c4caaed986521aae14c`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:47.684575 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-57d7cbf5-c045-4f95-b66f-a60f11868f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:47.735904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:47.780800 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 656/1316] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:42:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:47.821117 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a5568-a4fe-4ae5-bfbc-0acaa600675c None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:47.822667 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-799a5568-a4fe-4ae5-bfbc-0acaa600675c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:47.833104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:47.925587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a5568-a4fe-4ae5-bfbc-0acaa600675c None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:47.997415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616233b8-f1d5-4adb-8d46-8fdba26acab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:47.998008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616233b8-f1d5-4adb-8d46-8fdba26acab8 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:47.998294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616233b8-f1d5-4adb-8d46-8fdba26acab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:47.998568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616233b8-f1d5-4adb-8d46-8fdba26acab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:48.000176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-616233b8-f1d5-4adb-8d46-8fdba26acab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:48.061274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:48.107590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616233b8-f1d5-4adb-8d46-8fdba26acab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:48.109031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616233b8-f1d5-4adb-8d46-8fdba26acab8 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:48.127563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 661/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:50.877083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3757bb9-a581-4aa5-be96-47b893832a98 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:50.877643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3757bb9-a581-4aa5-be96-47b893832a98 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:50.877643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3757bb9-a581-4aa5-be96-47b893832a98 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:50.879057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 657/1318] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:42:50.884122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4926ea-bfab-4e3d-b0c6-0c766ba4d0f7 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:50.884507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4926ea-bfab-4e3d-b0c6-0c766ba4d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:50.884680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4926ea-bfab-4e3d-b0c6-0c766ba4d0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:50.955272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1c4926ea-bfab-4e3d-b0c6-0c766ba4d0f7 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:50.957360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1c4926ea-bfab-4e3d-b0c6-0c766ba4d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:51.055545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 662/1319] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:42:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:51.094835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3757bb9-a581-4aa5-be96-47b893832a98 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:51.096672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b3757bb9-a581-4aa5-be96-47b893832a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:51.198796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3757bb9-a581-4aa5-be96-47b893832a98 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:51.272868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ccc6-89f6-4d92-904d-b43a9917830e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:51.273513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ccc6-89f6-4d92-904d-b43a9917830e service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:51.273800 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ccc6-89f6-4d92-904d-b43a9917830e service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:51.274111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ccc6-89f6-4d92-904d-b43a9917830e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:51.275741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-5146ccc6-89f6-4d92-904d-b43a9917830e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:51.283232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:51.382422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146ccc6-89f6-4d92-904d-b43a9917830e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:51.383859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146ccc6-89f6-4d92-904d-b43a9917830e service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:51.401106 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 658/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:54.479354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648081a-bfcf-499b-a89c-4d7d98fbd8a1 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:54.479903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648081a-bfcf-499b-a89c-4d7d98fbd8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:54.479903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648081a-bfcf-499b-a89c-4d7d98fbd8a1 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:54.481190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 663/1321] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:42:54.486464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873b3ff-bc0f-4d4b-808b-e04988305d38 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:54.486887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873b3ff-bc0f-4d4b-808b-e04988305d38 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:54.487033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873b3ff-bc0f-4d4b-808b-e04988305d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:54.553569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1873b3ff-bc0f-4d4b-808b-e04988305d38 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:54.554831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1873b3ff-bc0f-4d4b-808b-e04988305d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:54.613029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:54.653111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 659/1322] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:42:54.689411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648081a-bfcf-499b-a89c-4d7d98fbd8a1 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:54.690999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4648081a-bfcf-499b-a89c-4d7d98fbd8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:54.712434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:54.806273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648081a-bfcf-499b-a89c-4d7d98fbd8a1 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:54.894087 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e3ead-d558-42bf-80f2-8717f8b9d416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:54.894747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e3ead-d558-42bf-80f2-8717f8b9d416 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:54.895034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e3ead-d558-42bf-80f2-8717f8b9d416 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:54.895313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e3ead-d558-42bf-80f2-8717f8b9d416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:54.896992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-220e3ead-d558-42bf-80f2-8717f8b9d416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:54.969418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:55.008282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e3ead-d558-42bf-80f2-8717f8b9d416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:55.009734 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e3ead-d558-42bf-80f2-8717f8b9d416 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:55.028520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 664/1323] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:57.122257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1908ae-cc78-4c9b-8549-6f62b1df573c None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:57.122787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1908ae-cc78-4c9b-8549-6f62b1df573c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:57.122906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1908ae-cc78-4c9b-8549-6f62b1df573c None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:57.124204 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 660/1324] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:42:57.129312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40555304-c8b0-4c13-92d8-8d85d80f25d5 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:57.129753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40555304-c8b0-4c13-92d8-8d85d80f25d5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:57.129878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40555304-c8b0-4c13-92d8-8d85d80f25d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:57.194930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-40555304-c8b0-4c13-92d8-8d85d80f25d5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:57.196022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-40555304-c8b0-4c13-92d8-8d85d80f25d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:57.292686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 665/1325] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:57.328407 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1908ae-cc78-4c9b-8549-6f62b1df573c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:57.330058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6c1908ae-cc78-4c9b-8549-6f62b1df573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:57.432254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1908ae-cc78-4c9b-8549-6f62b1df573c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:57.503468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b2171-e84f-427c-aa5e-8b0f442f9ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:57.504123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b2171-e84f-427c-aa5e-8b0f442f9ead service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:57.504406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b2171-e84f-427c-aa5e-8b0f442f9ead service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:57.504685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b2171-e84f-427c-aa5e-8b0f442f9ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:57.506328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1f3b2171-e84f-427c-aa5e-8b0f442f9ead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:57.523185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:57.618463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b2171-e84f-427c-aa5e-8b0f442f9ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:57.619912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b2171-e84f-427c-aa5e-8b0f442f9ead service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:57.638103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 661/1326] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:59.742251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65a2b1-f24c-42f5-8ec4-6f0063a4789f None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:59.742849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65a2b1-f24c-42f5-8ec4-6f0063a4789f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:59.742849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65a2b1-f24c-42f5-8ec4-6f0063a4789f None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:59.744192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 666/1327] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:42:59.749254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c5fa6-0b11-49ce-bbe4-d45bacc8b2d3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:59.749696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c5fa6-0b11-49ce-bbe4-d45bacc8b2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:59.749852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c5fa6-0b11-49ce-bbe4-d45bacc8b2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:59.814433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-628c5fa6-0b11-49ce-bbe4-d45bacc8b2d3 None None] MFA Rules not processed for user `5b58537fcdd84c4caaed986521aae14c`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:59.815629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-628c5fa6-0b11-49ce-bbe4-d45bacc8b2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:59.883640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:59.915171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 662/1328] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:59.953605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65a2b1-f24c-42f5-8ec4-6f0063a4789f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:59.955261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ab65a2b1-f24c-42f5-8ec4-6f0063a4789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:59.990242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:00.062969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65a2b1-f24c-42f5-8ec4-6f0063a4789f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:00.136545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85bac0-c523-42c8-9bda-d653410c2ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:00.137114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85bac0-c523-42c8-9bda-d653410c2ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:00.137405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85bac0-c523-42c8-9bda-d653410c2ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:00.137685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85bac0-c523-42c8-9bda-d653410c2ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:00.139365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fd85bac0-c523-42c8-9bda-d653410c2ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:00.217579 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:00.254078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85bac0-c523-42c8-9bda-d653410c2ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:00.254078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85bac0-c523-42c8-9bda-d653410c2ae4 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:00.269485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 667/1329] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:02.714474 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce60c-6fc5-4f72-bb09-fe7b7be395ad None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:02.715015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce60c-6fc5-4f72-bb09-fe7b7be395ad None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:02.715015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce60c-6fc5-4f72-bb09-fe7b7be395ad None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:02.716404 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 663/1330] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:02.722360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a93e3-5308-4503-a430-bd4f11151a47 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:02.722761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a93e3-5308-4503-a430-bd4f11151a47 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:02.722964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a93e3-5308-4503-a430-bd4f11151a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:02.787200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-e24a93e3-5308-4503-a430-bd4f11151a47 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:02.788383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e24a93e3-5308-4503-a430-bd4f11151a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:02.882774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 668/1331] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:02.919278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abce60c-6fc5-4f72-bb09-fe7b7be395ad None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:02.920785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3abce60c-6fc5-4f72-bb09-fe7b7be395ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:03.028854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abce60c-6fc5-4f72-bb09-fe7b7be395ad None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:03.106814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1f567-54ac-4b2b-ad1e-2af36a36059f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:03.107466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f567-54ac-4b2b-ad1e-2af36a36059f service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:03.107747 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f567-54ac-4b2b-ad1e-2af36a36059f service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:03.108023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f567-54ac-4b2b-ad1e-2af36a36059f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:03.109782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6ce1f567-54ac-4b2b-ad1e-2af36a36059f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:03.137063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:03.219322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1f567-54ac-4b2b-ad1e-2af36a36059f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:03.220712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1f567-54ac-4b2b-ad1e-2af36a36059f service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:03.238382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 664/1332] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:05.288189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e32b6-ad4a-48e9-b145-86466ce534fd None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:05.288724 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e32b6-ad4a-48e9-b145-86466ce534fd None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:05.288821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e32b6-ad4a-48e9-b145-86466ce534fd None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:05.290149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 669/1333] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:05.295281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9c0f-0bce-4aed-9937-42bdeb77e2f3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:05.295688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9c0f-0bce-4aed-9937-42bdeb77e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:05.295844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9c0f-0bce-4aed-9937-42bdeb77e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:05.364228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-384e9c0f-0bce-4aed-9937-42bdeb77e2f3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:05.365413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-384e9c0f-0bce-4aed-9937-42bdeb77e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:05.437790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:05.459692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 665/1334] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:43:05.514893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e95cc-3240-4504-9dc2-11a52f282b0f None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:05.515189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e95cc-3240-4504-9dc2-11a52f282b0f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:05.515477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e95cc-3240-4504-9dc2-11a52f282b0f None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:05.516899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 670/1335] 10.222.0.26 () {54 vars in 964 bytes} [Thu Jun 30 10:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:05.522736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a18c3-bd8a-433a-89a2-8930e5e62741 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:05.523028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a18c3-bd8a-433a-89a2-8930e5e62741 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:05.523304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a18c3-bd8a-433a-89a2-8930e5e62741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:05.598320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-733a18c3-bd8a-433a-89a2-8930e5e62741 None None] MFA Rules not processed for user `719afb6dcb154119beb18d2f1974fe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:05.599449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-733a18c3-bd8a-433a-89a2-8930e5e62741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:05.674767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 666/1336] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Jun 30 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:05.683789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e95cc-3240-4504-9dc2-11a52f282b0f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:05.685285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cd2e95cc-3240-4504-9dc2-11a52f282b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:05.724831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:05.788340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e95cc-3240-4504-9dc2-11a52f282b0f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:05.861144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275369b0-457e-46de-aa0b-9ba60d4d0286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:05.861705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275369b0-457e-46de-aa0b-9ba60d4d0286 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:05.862016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275369b0-457e-46de-aa0b-9ba60d4d0286 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:05.862290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275369b0-457e-46de-aa0b-9ba60d4d0286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:05.863892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-275369b0-457e-46de-aa0b-9ba60d4d0286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:05.946524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:05.972493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275369b0-457e-46de-aa0b-9ba60d4d0286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:05.973925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275369b0-457e-46de-aa0b-9ba60d4d0286 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:05.991656 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 671/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:09.277655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a76f4c-1313-4075-8ede-ee967f969fbe None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:09.278200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a76f4c-1313-4075-8ede-ee967f969fbe None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:09.278200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a76f4c-1313-4075-8ede-ee967f969fbe None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:09.279548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 667/1338] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:09.285336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4ad3-52ff-429f-9799-e7424b8d3bf2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:09.285737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4ad3-52ff-429f-9799-e7424b8d3bf2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:09.285901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4ad3-52ff-429f-9799-e7424b8d3bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:09.350697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-87be4ad3-52ff-429f-9799-e7424b8d3bf2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:09.351901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-87be4ad3-52ff-429f-9799-e7424b8d3bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:09.446386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 672/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:09.482747 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a76f4c-1313-4075-8ede-ee967f969fbe None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:09.484255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-86a76f4c-1313-4075-8ede-ee967f969fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:09.558230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:09.585480 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a76f4c-1313-4075-8ede-ee967f969fbe None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:09.658223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad25238-491d-4155-ba61-7ba57ea38444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:09.658875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad25238-491d-4155-ba61-7ba57ea38444 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:09.659163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad25238-491d-4155-ba61-7ba57ea38444 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:09.659441 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad25238-491d-4155-ba61-7ba57ea38444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:09.661055 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-cad25238-491d-4155-ba61-7ba57ea38444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:09.766953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad25238-491d-4155-ba61-7ba57ea38444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:09.768388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad25238-491d-4155-ba61-7ba57ea38444 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:09.785926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 668/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:14.091571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89996ab-5191-461d-8014-eb560e22e5a3 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:14.091571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89996ab-5191-461d-8014-eb560e22e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:14.091571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89996ab-5191-461d-8014-eb560e22e5a3 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:14.094333 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 673/1341] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:14.098301 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c7f7-3a69-459f-aecd-8de5124f43a1 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:14.098798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c7f7-3a69-459f-aecd-8de5124f43a1 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:14.098899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c7f7-3a69-459f-aecd-8de5124f43a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:14.105638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:14.171971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9da7c7f7-3a69-459f-aecd-8de5124f43a1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:14.173666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9da7c7f7-3a69-459f-aecd-8de5124f43a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:14.292708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 669/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:14.332314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89996ab-5191-461d-8014-eb560e22e5a3 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:14.334542 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f89996ab-5191-461d-8014-eb560e22e5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:14.387636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:14.433487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89996ab-5191-461d-8014-eb560e22e5a3 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:14.437323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a723ab5-9708-4f49-b9e4-0c9822fbc11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:14.438602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a723ab5-9708-4f49-b9e4-0c9822fbc11a service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:14.438886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a723ab5-9708-4f49-b9e4-0c9822fbc11a service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:14.439164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a723ab5-9708-4f49-b9e4-0c9822fbc11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:14.448414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a723ab5-9708-4f49-b9e4-0c9822fbc11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:14.449847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a723ab5-9708-4f49-b9e4-0c9822fbc11a service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:14.459091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 674/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:17.410658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d9dd1-0caf-43d8-a1f1-e77ff4c11b8c None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:17.411244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d9dd1-0caf-43d8-a1f1-e77ff4c11b8c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:17.411244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d9dd1-0caf-43d8-a1f1-e77ff4c11b8c None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:17.412658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 670/1344] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:17.418508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d44e2-8a49-4456-a070-e29af568f902 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:17.419042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d44e2-8a49-4456-a070-e29af568f902 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:17.419135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d44e2-8a49-4456-a070-e29af568f902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:17.448621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4b3d44e2-8a49-4456-a070-e29af568f902 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:17.449860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4b3d44e2-8a49-4456-a070-e29af568f902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:17.530631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 675/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:17.567847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d9dd1-0caf-43d8-a1f1-e77ff4c11b8c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:17.579264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d9dd1-0caf-43d8-a1f1-e77ff4c11b8c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:17.583003 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa900212-88c3-4bbe-9fa0-b03473caf2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:17.583653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa900212-88c3-4bbe-9fa0-b03473caf2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:17.583969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa900212-88c3-4bbe-9fa0-b03473caf2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:17.584247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa900212-88c3-4bbe-9fa0-b03473caf2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:17.593254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa900212-88c3-4bbe-9fa0-b03473caf2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:17.594750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa900212-88c3-4bbe-9fa0-b03473caf2b0 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:17.604319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 671/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:21.832504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13674c-74f9-4498-90fc-ce5186bb8204 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:21.833122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13674c-74f9-4498-90fc-ce5186bb8204 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:21.833122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13674c-74f9-4498-90fc-ce5186bb8204 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:21.834488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 676/1347] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:21.839729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb335-076d-4192-abf2-f234eeb3ad4d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:21.840174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb335-076d-4192-abf2-f234eeb3ad4d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:21.840290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb335-076d-4192-abf2-f234eeb3ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:21.858521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-36beb335-076d-4192-abf2-f234eeb3ad4d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:21.859726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-36beb335-076d-4192-abf2-f234eeb3ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:21.867555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 672/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:21.908039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13674c-74f9-4498-90fc-ce5186bb8204 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:21.920662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13674c-74f9-4498-90fc-ce5186bb8204 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:21.924257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43deb7-eac2-4d71-b768-cb64adb9f78f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:21.924898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43deb7-eac2-4d71-b768-cb64adb9f78f service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:21.925185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43deb7-eac2-4d71-b768-cb64adb9f78f service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:21.925464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43deb7-eac2-4d71-b768-cb64adb9f78f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:21.934765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43deb7-eac2-4d71-b768-cb64adb9f78f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:21.936231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43deb7-eac2-4d71-b768-cb64adb9f78f service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:21.946123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 677/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:26.965005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678d8fa-18cb-4601-9659-4fdef5e8a6c8 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:26.965876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678d8fa-18cb-4601-9659-4fdef5e8a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:26.966361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678d8fa-18cb-4601-9659-4fdef5e8a6c8 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:26.968192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 673/1350] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:26.973757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8404d1-7e7f-4109-98cf-1efd898e060e None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:26.974566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8404d1-7e7f-4109-98cf-1efd898e060e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:26.975023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8404d1-7e7f-4109-98cf-1efd898e060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:27.059030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-df8404d1-7e7f-4109-98cf-1efd898e060e None None] MFA Rules not processed for user `3238a52a3f6047e0acb0136ab39257e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:27.060475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-df8404d1-7e7f-4109-98cf-1efd898e060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:27.090362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:27.142313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 678/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:43:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:31.415271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1ff5-16a2-4526-8c98-d046592f241f None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:31.415854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1ff5-16a2-4526-8c98-d046592f241f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:31.415854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1ff5-16a2-4526-8c98-d046592f241f None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:31.417378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 674/1352] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:31.422972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd5a9-6b69-4fe9-b947-7e0396f23e7f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:31.424231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd5a9-6b69-4fe9-b947-7e0396f23e7f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:31.424231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd5a9-6b69-4fe9-b947-7e0396f23e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:31.442977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ad9bd5a9-6b69-4fe9-b947-7e0396f23e7f None None] MFA Rules not processed for user `3238a52a3f6047e0acb0136ab39257e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:31.444609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ad9bd5a9-6b69-4fe9-b947-7e0396f23e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:31.453515 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 679/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:43:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:31.853859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=72 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:33.079875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119bd9-bc34-43ae-bd3f-a2e97de9f6d5 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:33.080550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119bd9-bc34-43ae-bd3f-a2e97de9f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:33.080550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119bd9-bc34-43ae-bd3f-a2e97de9f6d5 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:33.081834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 675/1354] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:33.088596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c02f-54e0-41d5-abf9-0d3a2fd17711 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:33.089170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c02f-54e0-41d5-abf9-0d3a2fd17711 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:33.089504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c02f-54e0-41d5-abf9-0d3a2fd17711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:33.113422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d044c02f-54e0-41d5-abf9-0d3a2fd17711 None None] MFA Rules not processed for user `3238a52a3f6047e0acb0136ab39257e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:33.114690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d044c02f-54e0-41d5-abf9-0d3a2fd17711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:33.123244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 680/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:43:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:36.448863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c37597-aa37-4feb-95ed-3fede5f99c65 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:36.449410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c37597-aa37-4feb-95ed-3fede5f99c65 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:36.449410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c37597-aa37-4feb-95ed-3fede5f99c65 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:36.450746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 676/1356] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:36.456779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57aede-6027-4fc1-acf7-baf8a942b159 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:36.457289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57aede-6027-4fc1-acf7-baf8a942b159 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:36.457569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57aede-6027-4fc1-acf7-baf8a942b159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:36.476943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ef57aede-6027-4fc1-acf7-baf8a942b159 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:36.480963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ef57aede-6027-4fc1-acf7-baf8a942b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:36.487903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 681/1357] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:36.540873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5486486-41bb-474d-bb0a-bbea96c7cae9 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:36.541705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5486486-41bb-474d-bb0a-bbea96c7cae9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:36.542247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5486486-41bb-474d-bb0a-bbea96c7cae9 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:36.544341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 677/1358] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 30 10:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:36.552751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1520fc-4148-43df-a1f9-8691c457d648 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:36.553314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1520fc-4148-43df-a1f9-8691c457d648 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:36.553815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1520fc-4148-43df-a1f9-8691c457d648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:36.611240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-fa1520fc-4148-43df-a1f9-8691c457d648 None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:36.612519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fa1520fc-4148-43df-a1f9-8691c457d648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:36.704691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 682/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 30 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:36.712725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5486486-41bb-474d-bb0a-bbea96c7cae9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:36.727483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5486486-41bb-474d-bb0a-bbea96c7cae9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:36.733054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cddea1-eb72-49e0-9e84-933b2108cc27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:36.734427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cddea1-eb72-49e0-9e84-933b2108cc27 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:36.734860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cddea1-eb72-49e0-9e84-933b2108cc27 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:36.735299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cddea1-eb72-49e0-9e84-933b2108cc27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:36.744296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cddea1-eb72-49e0-9e84-933b2108cc27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:36.746095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cddea1-eb72-49e0-9e84-933b2108cc27 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:36.757003 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 678/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:39.032040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f08fa4-9889-4072-8477-1e7968375550 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:39.032547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f08fa4-9889-4072-8477-1e7968375550 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:39.032641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f08fa4-9889-4072-8477-1e7968375550 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:39.034204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 683/1361] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:39.039132 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e24df-0482-49d3-b358-829a7c4291d3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:39.039549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e24df-0482-49d3-b358-829a7c4291d3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:39.039693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e24df-0482-49d3-b358-829a7c4291d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:39.059002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-7b6e24df-0482-49d3-b358-829a7c4291d3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:39.060214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-7b6e24df-0482-49d3-b358-829a7c4291d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:39.068171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 679/1362] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:39.113918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f08fa4-9889-4072-8477-1e7968375550 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:39.128604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f08fa4-9889-4072-8477-1e7968375550 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:39.134086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cae04f-5571-4aaf-b70e-36f244297903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:39.134737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cae04f-5571-4aaf-b70e-36f244297903 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:39.135027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cae04f-5571-4aaf-b70e-36f244297903 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:39.135308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cae04f-5571-4aaf-b70e-36f244297903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:39.144809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cae04f-5571-4aaf-b70e-36f244297903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:39.146457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cae04f-5571-4aaf-b70e-36f244297903 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:39.157228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 684/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:41.626673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdf373-a95b-47fe-84c8-10a8f8f9db86 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.627546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdf373-a95b-47fe-84c8-10a8f8f9db86 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.627836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdf373-a95b-47fe-84c8-10a8f8f9db86 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.629235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 680/1364] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:41.634829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0e19-e3d6-4c1c-a9d4-d914ad5dbc84 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.635244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0e19-e3d6-4c1c-a9d4-d914ad5dbc84 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.639946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0e19-e3d6-4c1c-a9d4-d914ad5dbc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.654241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7f7c0e19-e3d6-4c1c-a9d4-d914ad5dbc84 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:41.656005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7f7c0e19-e3d6-4c1c-a9d4-d914ad5dbc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:41.665509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 685/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:41.712885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d500236-2439-453b-9153-e4e5c70f08e0 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.713182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d500236-2439-453b-9153-e4e5c70f08e0 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.713465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d500236-2439-453b-9153-e4e5c70f08e0 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.714951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 681/1366] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 30 10:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:41.720791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138750-63a7-4a15-bba0-0dd0cfe52f86 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.721335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138750-63a7-4a15-bba0-0dd0cfe52f86 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.721615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138750-63a7-4a15-bba0-0dd0cfe52f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.746419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-86138750-63a7-4a15-bba0-0dd0cfe52f86 None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:41.747677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-86138750-63a7-4a15-bba0-0dd0cfe52f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:41.772563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 686/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 30 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:41.781284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d500236-2439-453b-9153-e4e5c70f08e0 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:41.796674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d500236-2439-453b-9153-e4e5c70f08e0 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:41.802314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84b29d-1b6d-45f8-8c45-09e3c867ba29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:41.803080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b29d-1b6d-45f8-8c45-09e3c867ba29 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.803372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b29d-1b6d-45f8-8c45-09e3c867ba29 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.803653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b29d-1b6d-45f8-8c45-09e3c867ba29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.812451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84b29d-1b6d-45f8-8c45-09e3c867ba29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:41.814273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84b29d-1b6d-45f8-8c45-09e3c867ba29 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:41.824403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 682/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:44.081102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94075f-1982-4b19-92fa-31993556e0f8 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:44.081650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94075f-1982-4b19-92fa-31993556e0f8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:44.081650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94075f-1982-4b19-92fa-31993556e0f8 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:44.084322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 687/1369] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:44.088654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745946ab-b193-46ea-a5f8-fa4face8a97a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:44.089541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745946ab-b193-46ea-a5f8-fa4face8a97a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:44.089829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745946ab-b193-46ea-a5f8-fa4face8a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:44.109476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-745946ab-b193-46ea-a5f8-fa4face8a97a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:44.110737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-745946ab-b193-46ea-a5f8-fa4face8a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:44.120522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 683/1370] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:44.166076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94075f-1982-4b19-92fa-31993556e0f8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:44.181225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94075f-1982-4b19-92fa-31993556e0f8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:44.186981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcbefe-7b88-4964-9924-83adf04ccba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:44.187727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcbefe-7b88-4964-9924-83adf04ccba8 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:44.188078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcbefe-7b88-4964-9924-83adf04ccba8 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:44.188424 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcbefe-7b88-4964-9924-83adf04ccba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:44.196987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcbefe-7b88-4964-9924-83adf04ccba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:44.198615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcbefe-7b88-4964-9924-83adf04ccba8 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:44.209692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 688/1371] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:44.753498 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a1558-4231-40ab-83df-8ad601bbe870 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:44.753791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a1558-4231-40ab-83df-8ad601bbe870 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:44.754287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a1558-4231-40ab-83df-8ad601bbe870 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:44.755686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 684/1372] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:44.761010 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d34ce-7774-43e8-afdd-b8176329d929 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:44.761456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d34ce-7774-43e8-afdd-b8176329d929 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:44.761803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d34ce-7774-43e8-afdd-b8176329d929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:44.780814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-8b7d34ce-7774-43e8-afdd-b8176329d929 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:44.782043 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8b7d34ce-7774-43e8-afdd-b8176329d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:44.789970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 689/1373] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:45.137167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676311-caf0-4213-8526-810f81f6ce17 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:45.138419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676311-caf0-4213-8526-810f81f6ce17 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:45.138419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676311-caf0-4213-8526-810f81f6ce17 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:45.139977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 685/1374] 10.222.0.26 () {54 vars in 963 bytes} [Thu Jun 30 10:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:45.144701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd7140-fef8-4345-8781-637229e50423 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:45.145168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd7140-fef8-4345-8781-637229e50423 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:45.145329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd7140-fef8-4345-8781-637229e50423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:45.154444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:45.198307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d8dd7140-fef8-4345-8781-637229e50423 None None] MFA Rules not processed for user `19fd3da30bdb477e99dbbc2f7075f161`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:45.199705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d8dd7140-fef8-4345-8781-637229e50423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:45.262617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 690/1375] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Jun 30 10:43:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:45.270514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676311-caf0-4213-8526-810f81f6ce17 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:45.282030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676311-caf0-4213-8526-810f81f6ce17 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:45.285429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22c0a1-19d1-42f9-97f3-3efa1ce53b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:45.286102 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22c0a1-19d1-42f9-97f3-3efa1ce53b2d service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:45.286388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22c0a1-19d1-42f9-97f3-3efa1ce53b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:45.286662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22c0a1-19d1-42f9-97f3-3efa1ce53b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:45.295828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22c0a1-19d1-42f9-97f3-3efa1ce53b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:45.297830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22c0a1-19d1-42f9-97f3-3efa1ce53b2d service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:45.307679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 686/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:46.411740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d498e-15db-4919-bfa2-27585fbbf81b None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:46.412274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d498e-15db-4919-bfa2-27585fbbf81b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:46.412274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d498e-15db-4919-bfa2-27585fbbf81b None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:46.413558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 691/1377] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:46.418678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f66db-81f6-410e-ba35-7770f946e130 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:46.419129 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f66db-81f6-410e-ba35-7770f946e130 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:46.419270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f66db-81f6-410e-ba35-7770f946e130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:46.436450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-030f66db-81f6-410e-ba35-7770f946e130 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:46.437649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-030f66db-81f6-410e-ba35-7770f946e130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:46.445216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 687/1378] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:43:46.489365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d498e-15db-4919-bfa2-27585fbbf81b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:46.503421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d498e-15db-4919-bfa2-27585fbbf81b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:46.508785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dab2c-3a43-4b27-8db3-c411960d4cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:46.509412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dab2c-3a43-4b27-8db3-c411960d4cbf service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:46.509692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dab2c-3a43-4b27-8db3-c411960d4cbf service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:46.509987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dab2c-3a43-4b27-8db3-c411960d4cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:46.518696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dab2c-3a43-4b27-8db3-c411960d4cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:46.520327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dab2c-3a43-4b27-8db3-c411960d4cbf service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:46.529807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 692/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:48.742830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec640-438b-417b-bcd1-3a4b02f2df1e None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:48.743402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec640-438b-417b-bcd1-3a4b02f2df1e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:48.743498 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec640-438b-417b-bcd1-3a4b02f2df1e None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:48.744982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 688/1380] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:48.750168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff68f1-e2d8-45ae-b68c-52a4ec172616 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:48.750622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff68f1-e2d8-45ae-b68c-52a4ec172616 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:48.750755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff68f1-e2d8-45ae-b68c-52a4ec172616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:48.768869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c1ff68f1-e2d8-45ae-b68c-52a4ec172616 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:48.770104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c1ff68f1-e2d8-45ae-b68c-52a4ec172616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:48.778513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 693/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:48.825520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecec640-438b-417b-bcd1-3a4b02f2df1e None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:48.840609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecec640-438b-417b-bcd1-3a4b02f2df1e None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:48.846929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4ceb4-dfeb-4573-9127-30b8237cb140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:48.847658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ceb4-dfeb-4573-9127-30b8237cb140 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:48.848014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ceb4-dfeb-4573-9127-30b8237cb140 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:48.848358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ceb4-dfeb-4573-9127-30b8237cb140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:48.856980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ceb4-dfeb-4573-9127-30b8237cb140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:48.858752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ceb4-dfeb-4573-9127-30b8237cb140 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:48.880129 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 689/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:51.092650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab954cf-d4fc-42f4-b41f-833b43261534 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:51.093521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab954cf-d4fc-42f4-b41f-833b43261534 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:51.093802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab954cf-d4fc-42f4-b41f-833b43261534 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:51.095342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 694/1383] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:51.100900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedad75a-65f2-4bac-9fd3-a5c74a8d5185 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:51.101338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedad75a-65f2-4bac-9fd3-a5c74a8d5185 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:51.101511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedad75a-65f2-4bac-9fd3-a5c74a8d5185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:51.120132 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-bedad75a-65f2-4bac-9fd3-a5c74a8d5185 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:51.121403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bedad75a-65f2-4bac-9fd3-a5c74a8d5185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:51.129990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 690/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:51.170238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab954cf-d4fc-42f4-b41f-833b43261534 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:51.185084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab954cf-d4fc-42f4-b41f-833b43261534 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:51.191014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03c1dc-c7e1-4f19-ab64-b49015676595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:51.191650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03c1dc-c7e1-4f19-ab64-b49015676595 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:51.191937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03c1dc-c7e1-4f19-ab64-b49015676595 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:51.192216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03c1dc-c7e1-4f19-ab64-b49015676595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:51.200301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03c1dc-c7e1-4f19-ab64-b49015676595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:51.201928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03c1dc-c7e1-4f19-ab64-b49015676595 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:51.211492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 695/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:53.256524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cf2df-9525-464e-a061-ccb4ad957a94 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:53.257076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cf2df-9525-464e-a061-ccb4ad957a94 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:53.257286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cf2df-9525-464e-a061-ccb4ad957a94 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:53.259269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 691/1386] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:53.264856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c7dc0-60c9-4ebc-abc4-ada3aa6a7eaf None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:53.265470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c7dc0-60c9-4ebc-abc4-ada3aa6a7eaf None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:53.265470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c7dc0-60c9-4ebc-abc4-ada3aa6a7eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:53.283736 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-6e5c7dc0-60c9-4ebc-abc4-ada3aa6a7eaf None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:53.284995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6e5c7dc0-60c9-4ebc-abc4-ada3aa6a7eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:53.293269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 696/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:53.341623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cf2df-9525-464e-a061-ccb4ad957a94 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:53.356498 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cf2df-9525-464e-a061-ccb4ad957a94 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:53.362566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ce278-eb1e-47cc-9156-86c7d173d822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:53.363228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ce278-eb1e-47cc-9156-86c7d173d822 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:53.363510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ce278-eb1e-47cc-9156-86c7d173d822 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:53.363793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ce278-eb1e-47cc-9156-86c7d173d822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:53.372500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ce278-eb1e-47cc-9156-86c7d173d822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:53.374756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ce278-eb1e-47cc-9156-86c7d173d822 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:53.384387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 692/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:55.728432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298f8b-6688-4955-97e2-20a043dd491c None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:55.729120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298f8b-6688-4955-97e2-20a043dd491c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:55.729120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298f8b-6688-4955-97e2-20a043dd491c None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:55.730489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 697/1389] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:55.735879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d09f03-9e9a-44da-af31-c95cbb8e83b2 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:55.736403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d09f03-9e9a-44da-af31-c95cbb8e83b2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:55.736631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d09f03-9e9a-44da-af31-c95cbb8e83b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:55.754714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-71d09f03-9e9a-44da-af31-c95cbb8e83b2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:55.755903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-71d09f03-9e9a-44da-af31-c95cbb8e83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:55.763689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 693/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:55.809469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298f8b-6688-4955-97e2-20a043dd491c None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:55.824187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298f8b-6688-4955-97e2-20a043dd491c None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:55.830256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbe976-7903-4ce0-9b1c-c5af65f61b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:55.830889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe976-7903-4ce0-9b1c-c5af65f61b7f service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:55.831175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe976-7903-4ce0-9b1c-c5af65f61b7f service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:55.831456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe976-7903-4ce0-9b1c-c5af65f61b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:55.840140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbe976-7903-4ce0-9b1c-c5af65f61b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:55.841730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbe976-7903-4ce0-9b1c-c5af65f61b7f service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:55.851846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 698/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:58.132436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454dda-ce23-4c24-9397-6cf5499f3baf None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:58.132972 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454dda-ce23-4c24-9397-6cf5499f3baf None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:58.133111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454dda-ce23-4c24-9397-6cf5499f3baf None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:58.135047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 694/1392] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:43:58.140290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fce902-f542-4b4e-92bb-50e5278a1c06 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:58.140710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fce902-f542-4b4e-92bb-50e5278a1c06 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:58.140860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fce902-f542-4b4e-92bb-50e5278a1c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:58.159471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c7fce902-f542-4b4e-92bb-50e5278a1c06 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:58.160612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c7fce902-f542-4b4e-92bb-50e5278a1c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:58.170192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 699/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:58.215277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87454dda-ce23-4c24-9397-6cf5499f3baf None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:58.235856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87454dda-ce23-4c24-9397-6cf5499f3baf None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:58.243109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474097f4-a0a3-4128-aefd-e94990e95c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:58.243994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474097f4-a0a3-4128-aefd-e94990e95c5a service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:58.244382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474097f4-a0a3-4128-aefd-e94990e95c5a service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:58.244731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474097f4-a0a3-4128-aefd-e94990e95c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:58.255630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474097f4-a0a3-4128-aefd-e94990e95c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:58.257771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474097f4-a0a3-4128-aefd-e94990e95c5a service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:58.270618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 695/1394] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:00.429354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56694e-33ae-467d-b93b-996d12658fbb None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:00.429929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56694e-33ae-467d-b93b-996d12658fbb None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:00.429929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56694e-33ae-467d-b93b-996d12658fbb None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:00.431724 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 700/1395] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:44:00.437049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47252fbc-8a39-45a5-9242-0db0a88bdded None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:00.438053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47252fbc-8a39-45a5-9242-0db0a88bdded None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:00.438259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47252fbc-8a39-45a5-9242-0db0a88bdded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:00.456290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-47252fbc-8a39-45a5-9242-0db0a88bdded None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:00.457480 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-47252fbc-8a39-45a5-9242-0db0a88bdded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:00.465238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 696/1396] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:00.508974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56694e-33ae-467d-b93b-996d12658fbb None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:00.523669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56694e-33ae-467d-b93b-996d12658fbb None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:00.529005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d3b7-5e54-435d-8666-b4edea87a0ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:00.529641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d3b7-5e54-435d-8666-b4edea87a0ad service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:00.529929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d3b7-5e54-435d-8666-b4edea87a0ad service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:00.530236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d3b7-5e54-435d-8666-b4edea87a0ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:00.538457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553d3b7-5e54-435d-8666-b4edea87a0ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:00.540036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553d3b7-5e54-435d-8666-b4edea87a0ad service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:00.550080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 701/1397] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:00.740647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc333d8-9010-44ca-b5c4-bdf02db6381f None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:00.740856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc333d8-9010-44ca-b5c4-bdf02db6381f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:00.741124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc333d8-9010-44ca-b5c4-bdf02db6381f None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:00.742551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 697/1398] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:00.747841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463e95-c599-42d9-8e31-8bf19cda44cc None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:00.748140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463e95-c599-42d9-8e31-8bf19cda44cc None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:00.748421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463e95-c599-42d9-8e31-8bf19cda44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:00.768721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-80463e95-c599-42d9-8e31-8bf19cda44cc None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:00.770008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-80463e95-c599-42d9-8e31-8bf19cda44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:00.778155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 702/1399] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:00.836201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bf3e8-e5e9-460e-93f7-77e639c6e8e4 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:00.836600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bf3e8-e5e9-460e-93f7-77e639c6e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:00.836946 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bf3e8-e5e9-460e-93f7-77e639c6e8e4 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:00.838538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 698/1400] 10.222.0.26 () {54 vars in 962 bytes} [Thu Jun 30 10:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:00.843999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91378-314d-43ad-a736-2af5bf4fcf82 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:00.844294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91378-314d-43ad-a736-2af5bf4fcf82 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:00.844609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91378-314d-43ad-a736-2af5bf4fcf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:00.903388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-88c91378-314d-43ad-a736-2af5bf4fcf82 None None] MFA Rules not processed for user `9e839d1074f24a5ba7a552472e167067`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:00.904596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-88c91378-314d-43ad-a736-2af5bf4fcf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:00.938320 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:00.965602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 703/1401] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Jun 30 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:00.973930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bf3e8-e5e9-460e-93f7-77e639c6e8e4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:00.984995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bf3e8-e5e9-460e-93f7-77e639c6e8e4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:00.988499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedac9a1-7c5c-4be3-8fea-80282b879939 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e839d1074f24a5ba7a552472e167067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:00.989137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedac9a1-7c5c-4be3-8fea-80282b879939 service glance] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:00.989428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedac9a1-7c5c-4be3-8fea-80282b879939 service glance] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:00.989709 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedac9a1-7c5c-4be3-8fea-80282b879939 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:00.998872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedac9a1-7c5c-4be3-8fea-80282b879939 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:01.000278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedac9a1-7c5c-4be3-8fea-80282b879939 service glance] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:01.010619 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 699/1402] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:01.974864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fb981-0dba-462f-a45f-38c623351a5c None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:01.975383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fb981-0dba-462f-a45f-38c623351a5c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:01.975504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fb981-0dba-462f-a45f-38c623351a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:02.023487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c48fb981-0dba-462f-a45f-38c623351a5c None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:02.024737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c48fb981-0dba-462f-a45f-38c623351a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:02.089995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 704/1403] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:44:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:02.134223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6df4b8-c249-45fa-badc-48a342fd9b64 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:02.134679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6df4b8-c249-45fa-badc-48a342fd9b64 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:02.134779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6df4b8-c249-45fa-badc-48a342fd9b64 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:02.136151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 700/1404] 10.222.0.26 () {54 vars in 942 bytes} [Thu Jun 30 10:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:02.143351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c045b5a-e32a-4c01-a27f-7b510501d6c6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:02.143647 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c045b5a-e32a-4c01-a27f-7b510501d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:02.143929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c045b5a-e32a-4c01-a27f-7b510501d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:02.192520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-2c045b5a-e32a-4c01-a27f-7b510501d6c6 None None] MFA Rules not processed for user `f93427bde8154d509bc67675b03903db`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:02.193754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2c045b5a-e32a-4c01-a27f-7b510501d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:02.266802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 705/1405] 10.222.0.26 () {58 vars in 1039 bytes} [Thu Jun 30 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:44:02.275967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6df4b8-c249-45fa-badc-48a342fd9b64 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:02.284148 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=61 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:02.290541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6df4b8-c249-45fa-badc-48a342fd9b64 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:02.295478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c75f6-9a85-4351-9e12-e5cdb015710c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:02.296102 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c75f6-9a85-4351-9e12-e5cdb015710c service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:02.296390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c75f6-9a85-4351-9e12-e5cdb015710c service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:02.296707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c75f6-9a85-4351-9e12-e5cdb015710c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:02.304933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c75f6-9a85-4351-9e12-e5cdb015710c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:02.306582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c75f6-9a85-4351-9e12-e5cdb015710c service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:02.315195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 701/1406] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:44:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:44:02.776003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f6e5-e591-4ce4-81e0-1375a6411f86 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:02.776463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f6e5-e591-4ce4-81e0-1375a6411f86 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:02.776843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f6e5-e591-4ce4-81e0-1375a6411f86 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:02.778530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 706/1407] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:02.784126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a58df4-9701-43b5-a614-24f5587714b8 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:02.784422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a58df4-9701-43b5-a614-24f5587714b8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:02.784710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a58df4-9701-43b5-a614-24f5587714b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:02.803570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-86a58df4-9701-43b5-a614-24f5587714b8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:02.804754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-86a58df4-9701-43b5-a614-24f5587714b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:02.816316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 702/1408] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:02.861336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f6e5-e591-4ce4-81e0-1375a6411f86 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:02.876720 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f6e5-e591-4ce4-81e0-1375a6411f86 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:02.882584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e82ca-b7cb-44b9-ae49-e37c3799a652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:02.883314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e82ca-b7cb-44b9-ae49-e37c3799a652 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:02.883610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e82ca-b7cb-44b9-ae49-e37c3799a652 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:02.883886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e82ca-b7cb-44b9-ae49-e37c3799a652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:02.899186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e82ca-b7cb-44b9-ae49-e37c3799a652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:02.901024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e82ca-b7cb-44b9-ae49-e37c3799a652 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:02.907565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:02.912848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 707/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:12.798190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=8 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:26.128745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a5bfc-3681-46cb-9ba5-4336677dabe4 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:26.129403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a5bfc-3681-46cb-9ba5-4336677dabe4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:26.129403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a5bfc-3681-46cb-9ba5-4336677dabe4 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:26.130733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 703/1410] 10.222.0.26 () {54 vars in 918 bytes} [Thu Jun 30 10:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:26.135792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706a13-54ad-48cd-b37e-970cb2a8ace3 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:26.136244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706a13-54ad-48cd-b37e-970cb2a8ace3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:26.136353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706a13-54ad-48cd-b37e-970cb2a8ace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:26.154717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-88706a13-54ad-48cd-b37e-970cb2a8ace3 None None] MFA Rules not processed for user `3238a52a3f6047e0acb0136ab39257e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:26.156438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-88706a13-54ad-48cd-b37e-970cb2a8ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:26.164875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 708/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Jun 30 10:44:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:26.178489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c204c-cfb9-40d4-a7c7-a8b02bb4cbb6 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:26.178787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c204c-cfb9-40d4-a7c7-a8b02bb4cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:26.179070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c204c-cfb9-40d4-a7c7-a8b02bb4cbb6 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:26.180424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 704/1412] 10.222.0.26 () {54 vars in 918 bytes} [Thu Jun 30 10:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:26.184872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6ca91-757e-40ae-858c-8ffcb72cb371 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:26.185164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6ca91-757e-40ae-858c-8ffcb72cb371 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:26.185443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6ca91-757e-40ae-858c-8ffcb72cb371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:26.203251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-e8c6ca91-757e-40ae-858c-8ffcb72cb371 None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:26.204429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e8c6ca91-757e-40ae-858c-8ffcb72cb371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:26.213429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 709/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Jun 30 10:44:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:28.696741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd244bf-8c90-4e4e-a776-74ff318b3fc0 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:28.697262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd244bf-8c90-4e4e-a776-74ff318b3fc0 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:28.697368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd244bf-8c90-4e4e-a776-74ff318b3fc0 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:28.698807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:28.704791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ad48-513a-4495-b0f0-564dda6aaa5e None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:28.705234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ad48-513a-4495-b0f0-564dda6aaa5e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:28.705350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ad48-513a-4495-b0f0-564dda6aaa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:28.723434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c780ad48-513a-4495-b0f0-564dda6aaa5e None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:28.724615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c780ad48-513a-4495-b0f0-564dda6aaa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:28.732895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:44:28.775634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd244bf-8c90-4e4e-a776-74ff318b3fc0 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:28.790477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd244bf-8c90-4e4e-a776-74ff318b3fc0 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:28.795941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e7373-de31-4355-a041-5df39a41e0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:28.797128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e7373-de31-4355-a041-5df39a41e0d1 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:28.797418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e7373-de31-4355-a041-5df39a41e0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:28.797701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e7373-de31-4355-a041-5df39a41e0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:28.805805 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e7373-de31-4355-a041-5df39a41e0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:28.807419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e7373-de31-4355-a041-5df39a41e0d1 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:28.816812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 706/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:29.706959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bc113-32cf-40a6-a80c-28ada7b56a3e None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:29.707546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bc113-32cf-40a6-a80c-28ada7b56a3e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:29.707546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bc113-32cf-40a6-a80c-28ada7b56a3e None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:29.708948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:29.713904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b8f0-bb14-465a-89ce-bea05f24ecd8 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:29.714343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b8f0-bb14-465a-89ce-bea05f24ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:29.714533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b8f0-bb14-465a-89ce-bea05f24ecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:29.732924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3a79b8f0-bb14-465a-89ce-bea05f24ecd8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:29.734792 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3a79b8f0-bb14-465a-89ce-bea05f24ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:29.742557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:29.892919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bc113-32cf-40a6-a80c-28ada7b56a3e None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:29.908084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bc113-32cf-40a6-a80c-28ada7b56a3e None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:29.914355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3f76e-590a-477a-8d80-2c235bf6f9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:29.914355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3f76e-590a-477a-8d80-2c235bf6f9d2 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:29.914355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3f76e-590a-477a-8d80-2c235bf6f9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:29.914730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3f76e-590a-477a-8d80-2c235bf6f9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:29.923516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3f76e-590a-477a-8d80-2c235bf6f9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:29.925113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3f76e-590a-477a-8d80-2c235bf6f9d2 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:29.934757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 712/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:30.817007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405fd52-fd9d-4021-8585-1205cb56da57 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:30.817581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405fd52-fd9d-4021-8585-1205cb56da57 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:30.817581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405fd52-fd9d-4021-8585-1205cb56da57 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:30.818999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:30.824055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299caa8-9da5-4909-98cd-ce7bf729d93d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:30.824456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299caa8-9da5-4909-98cd-ce7bf729d93d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:30.824614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299caa8-9da5-4909-98cd-ce7bf729d93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:30.842069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-8299caa8-9da5-4909-98cd-ce7bf729d93d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:30.843251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8299caa8-9da5-4909-98cd-ce7bf729d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:30.851096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:31.001623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405fd52-fd9d-4021-8585-1205cb56da57 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:31.015809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405fd52-fd9d-4021-8585-1205cb56da57 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:31.021155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063c3cb-9c06-4eb7-b58f-eea3cf605508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:31.021788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063c3cb-9c06-4eb7-b58f-eea3cf605508 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:31.022111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063c3cb-9c06-4eb7-b58f-eea3cf605508 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:31.022393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063c3cb-9c06-4eb7-b58f-eea3cf605508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:31.031249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063c3cb-9c06-4eb7-b58f-eea3cf605508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:31.032896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063c3cb-9c06-4eb7-b58f-eea3cf605508 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:31.042506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 709/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:31.891005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d8f23-2278-4e81-a6ab-95b649b8c919 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:31.891553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d8f23-2278-4e81-a6ab-95b649b8c919 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:31.891553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d8f23-2278-4e81-a6ab-95b649b8c919 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:31.892936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:31.898066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b586f24-b582-440b-be1c-d5b5a77234c5 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:31.898467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b586f24-b582-440b-be1c-d5b5a77234c5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:31.898628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b586f24-b582-440b-be1c-d5b5a77234c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:31.916485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1b586f24-b582-440b-be1c-d5b5a77234c5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:31.917667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1b586f24-b582-440b-be1c-d5b5a77234c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:31.925302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:32.075344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d8f23-2278-4e81-a6ab-95b649b8c919 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:32.089634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d8f23-2278-4e81-a6ab-95b649b8c919 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:32.095040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4381-09d1-4b6c-81b7-9925a06b7c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:32.095943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4381-09d1-4b6c-81b7-9925a06b7c45 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:32.096230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4381-09d1-4b6c-81b7-9925a06b7c45 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:32.096521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4381-09d1-4b6c-81b7-9925a06b7c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:32.104579 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de4381-09d1-4b6c-81b7-9925a06b7c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:32.106201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de4381-09d1-4b6c-81b7-9925a06b7c45 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:32.116006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 715/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:32.967420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb3e6-b399-4d1a-8831-8419cf429c47 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:32.967964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb3e6-b399-4d1a-8831-8419cf429c47 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:32.967964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb3e6-b399-4d1a-8831-8419cf429c47 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:32.970048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:32.975154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1495-a939-4eb7-9d8b-e658e605e7f5 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:32.975536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1495-a939-4eb7-9d8b-e658e605e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:32.975724 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1495-a939-4eb7-9d8b-e658e605e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:32.993753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c93f1495-a939-4eb7-9d8b-e658e605e7f5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:32.995065 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c93f1495-a939-4eb7-9d8b-e658e605e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:33.002895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:33.152572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcb3e6-b399-4d1a-8831-8419cf429c47 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:33.167160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcb3e6-b399-4d1a-8831-8419cf429c47 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:33.173123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78faecc4-cc00-4830-8110-18cff1a8c60c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:33.173748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faecc4-cc00-4830-8110-18cff1a8c60c service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:33.174058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faecc4-cc00-4830-8110-18cff1a8c60c service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:33.174334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faecc4-cc00-4830-8110-18cff1a8c60c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:33.182287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78faecc4-cc00-4830-8110-18cff1a8c60c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:33.183844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78faecc4-cc00-4830-8110-18cff1a8c60c service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:33.192986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 712/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:34.057933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b723-14cd-4b51-8b1d-5545c99f149d None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:34.058476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b723-14cd-4b51-8b1d-5545c99f149d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:34.058727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b723-14cd-4b51-8b1d-5545c99f149d None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:34.060102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:34.065074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a814-38fb-4614-b2b1-748848c33dfe None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:34.065512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a814-38fb-4614-b2b1-748848c33dfe None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:34.065644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a814-38fb-4614-b2b1-748848c33dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:34.083237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-7b00a814-38fb-4614-b2b1-748848c33dfe None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:34.084415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-7b00a814-38fb-4614-b2b1-748848c33dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:34.092162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:34.243388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b723-14cd-4b51-8b1d-5545c99f149d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:34.257406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b723-14cd-4b51-8b1d-5545c99f149d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:34.262781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54b57a-621a-4f2c-a284-ac33686188a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:34.263431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b57a-621a-4f2c-a284-ac33686188a3 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:34.263721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b57a-621a-4f2c-a284-ac33686188a3 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:34.264001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b57a-621a-4f2c-a284-ac33686188a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:34.272622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54b57a-621a-4f2c-a284-ac33686188a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:34.274245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54b57a-621a-4f2c-a284-ac33686188a3 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:34.284077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 718/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:35.170722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23639d8-09ef-4ed6-a203-794f20e7cbf8 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:35.171265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23639d8-09ef-4ed6-a203-794f20e7cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:35.171265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23639d8-09ef-4ed6-a203-794f20e7cbf8 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:35.172615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:35.177609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd6f57-f393-4cac-a3f9-6dca4899f0e1 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:35.178063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd6f57-f393-4cac-a3f9-6dca4899f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:35.178256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd6f57-f393-4cac-a3f9-6dca4899f0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:35.195869 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-85fd6f57-f393-4cac-a3f9-6dca4899f0e1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:35.197058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-85fd6f57-f393-4cac-a3f9-6dca4899f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:35.205394 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:35.353926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23639d8-09ef-4ed6-a203-794f20e7cbf8 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:35.368979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23639d8-09ef-4ed6-a203-794f20e7cbf8 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:35.374854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9287c2-4421-4580-8ed8-9d078005942f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:35.375479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9287c2-4421-4580-8ed8-9d078005942f service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:35.375761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9287c2-4421-4580-8ed8-9d078005942f service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:35.376033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9287c2-4421-4580-8ed8-9d078005942f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:35.384241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9287c2-4421-4580-8ed8-9d078005942f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:35.385820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9287c2-4421-4580-8ed8-9d078005942f service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:35.400171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 715/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:36.271137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141633e1-0ef0-42c2-8a19-4a76a466230d None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:36.271761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141633e1-0ef0-42c2-8a19-4a76a466230d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:36.271761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141633e1-0ef0-42c2-8a19-4a76a466230d None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:36.272972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:36.277850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102c9b-c521-45de-ba70-1e6e051359d2 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:36.278297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102c9b-c521-45de-ba70-1e6e051359d2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:36.278466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102c9b-c521-45de-ba70-1e6e051359d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:36.297134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a0102c9b-c521-45de-ba70-1e6e051359d2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:36.298368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a0102c9b-c521-45de-ba70-1e6e051359d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:36.305965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:36.456287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141633e1-0ef0-42c2-8a19-4a76a466230d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:36.470510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141633e1-0ef0-42c2-8a19-4a76a466230d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:36.476147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2866768-4402-4046-a6b7-b8c0e02b6a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:36.476783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2866768-4402-4046-a6b7-b8c0e02b6a42 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:36.477074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2866768-4402-4046-a6b7-b8c0e02b6a42 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:36.477354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2866768-4402-4046-a6b7-b8c0e02b6a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:36.485588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2866768-4402-4046-a6b7-b8c0e02b6a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:36.488084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2866768-4402-4046-a6b7-b8c0e02b6a42 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:36.497571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 721/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:37.362372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd12b97-a240-46ed-b7ea-d4f4c2fa5494 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:37.363009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd12b97-a240-46ed-b7ea-d4f4c2fa5494 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:37.363009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd12b97-a240-46ed-b7ea-d4f4c2fa5494 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:37.364300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:37.369069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960475e-65d6-4985-9294-c4fe79a33d0f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:37.369527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960475e-65d6-4985-9294-c4fe79a33d0f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:37.369638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960475e-65d6-4985-9294-c4fe79a33d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:37.387492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f960475e-65d6-4985-9294-c4fe79a33d0f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:37.388698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f960475e-65d6-4985-9294-c4fe79a33d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:37.397035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:37.545883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd12b97-a240-46ed-b7ea-d4f4c2fa5494 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:37.559883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd12b97-a240-46ed-b7ea-d4f4c2fa5494 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:37.565430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728a392-165f-4453-998b-88e3ec9f93a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:37.566115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a392-165f-4453-998b-88e3ec9f93a1 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:37.566408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a392-165f-4453-998b-88e3ec9f93a1 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:37.566688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a392-165f-4453-998b-88e3ec9f93a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:37.574867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728a392-165f-4453-998b-88e3ec9f93a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:37.576450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728a392-165f-4453-998b-88e3ec9f93a1 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:37.586238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 718/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:39.530610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c98274-cdb6-447d-a0f2-b9fa63cd56d8 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:39.531179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c98274-cdb6-447d-a0f2-b9fa63cd56d8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:39.531179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c98274-cdb6-447d-a0f2-b9fa63cd56d8 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:39.532592 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:39.537861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355780c-35f3-4b75-b7c3-71273a5a4ac1 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:39.538320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355780c-35f3-4b75-b7c3-71273a5a4ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:39.538456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355780c-35f3-4b75-b7c3-71273a5a4ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:39.556037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1355780c-35f3-4b75-b7c3-71273a5a4ac1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:39.557210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1355780c-35f3-4b75-b7c3-71273a5a4ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:39.565418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:39.602534 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c98274-cdb6-447d-a0f2-b9fa63cd56d8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:39.614074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c98274-cdb6-447d-a0f2-b9fa63cd56d8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:39.617600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4deb7-a367-4492-bb4d-17920d7ed562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:39.618277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4deb7-a367-4492-bb4d-17920d7ed562 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:39.618562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4deb7-a367-4492-bb4d-17920d7ed562 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:39.618841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4deb7-a367-4492-bb4d-17920d7ed562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:39.628151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4deb7-a367-4492-bb4d-17920d7ed562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:39.629576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4deb7-a367-4492-bb4d-17920d7ed562 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:39.638879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 724/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:41.879187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad7bd3-95dc-447c-addb-047945468e80 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:41.879751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad7bd3-95dc-447c-addb-047945468e80 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:41.879751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad7bd3-95dc-447c-addb-047945468e80 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:41.881138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:41.886547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fd1c6-78d7-4f6e-b7a7-578dab6bd5a7 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:41.886980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fd1c6-78d7-4f6e-b7a7-578dab6bd5a7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:41.887101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fd1c6-78d7-4f6e-b7a7-578dab6bd5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:41.906849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-831fd1c6-78d7-4f6e-b7a7-578dab6bd5a7 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:41.908076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-831fd1c6-78d7-4f6e-b7a7-578dab6bd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:41.916025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:41.954090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad7bd3-95dc-447c-addb-047945468e80 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:41.964761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad7bd3-95dc-447c-addb-047945468e80 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:41.968769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f84dd-cda6-43d6-8283-74c176470bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:41.969407 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f84dd-cda6-43d6-8283-74c176470bbb service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:41.969700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f84dd-cda6-43d6-8283-74c176470bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:41.970022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f84dd-cda6-43d6-8283-74c176470bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:41.979092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f84dd-cda6-43d6-8283-74c176470bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:41.980553 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f84dd-cda6-43d6-8283-74c176470bbb service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:41.989851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 721/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:44.346502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d9fa1-7706-472c-a2cd-5727727dff04 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:44.347063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d9fa1-7706-472c-a2cd-5727727dff04 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:44.347172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d9fa1-7706-472c-a2cd-5727727dff04 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:44.348444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:44.353526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a75bc-90b4-4db1-9b58-2ab1333e7010 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:44.353908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a75bc-90b4-4db1-9b58-2ab1333e7010 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:44.354135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a75bc-90b4-4db1-9b58-2ab1333e7010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:44.372481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2b1a75bc-90b4-4db1-9b58-2ab1333e7010 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:44.373661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2b1a75bc-90b4-4db1-9b58-2ab1333e7010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:44.381930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:44.419584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d9fa1-7706-472c-a2cd-5727727dff04 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:44.431056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d9fa1-7706-472c-a2cd-5727727dff04 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:44.434735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2a5a-265b-42c1-b41e-acb8097ea1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:44.435378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2a5a-265b-42c1-b41e-acb8097ea1aa service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:44.435670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2a5a-265b-42c1-b41e-acb8097ea1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:44.435977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2a5a-265b-42c1-b41e-acb8097ea1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:44.444991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2a5a-265b-42c1-b41e-acb8097ea1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:44.446471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2a5a-265b-42c1-b41e-acb8097ea1aa service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:44.455861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 727/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:46.590757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532072ce-a38d-445d-b37d-b028291139b5 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:46.591324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532072ce-a38d-445d-b37d-b028291139b5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:46.591324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532072ce-a38d-445d-b37d-b028291139b5 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:46.593293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:46.598679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84397da-f4b4-4ea3-8e6c-c847b352a9ad None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:46.599127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84397da-f4b4-4ea3-8e6c-c847b352a9ad None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:46.599274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84397da-f4b4-4ea3-8e6c-c847b352a9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:46.617623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b84397da-f4b4-4ea3-8e6c-c847b352a9ad None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:46.618845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b84397da-f4b4-4ea3-8e6c-c847b352a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:46.627170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:46.665110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532072ce-a38d-445d-b37d-b028291139b5 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:46.675674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532072ce-a38d-445d-b37d-b028291139b5 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:46.679082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a191cd-9c01-4a66-aa43-d842596a0956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:46.679710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a191cd-9c01-4a66-aa43-d842596a0956 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:46.679996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a191cd-9c01-4a66-aa43-d842596a0956 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:46.680273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a191cd-9c01-4a66-aa43-d842596a0956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:46.689483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a191cd-9c01-4a66-aa43-d842596a0956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:46.690931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a191cd-9c01-4a66-aa43-d842596a0956 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:46.700241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 724/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:48.742048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38307053-64f2-4cfa-b04d-919a6dd1f737 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:48.742611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38307053-64f2-4cfa-b04d-919a6dd1f737 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:48.742611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38307053-64f2-4cfa-b04d-919a6dd1f737 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:48.743974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:48.749901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4fd2-e112-44a8-b220-a5b0cfb620f6 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:48.750322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4fd2-e112-44a8-b220-a5b0cfb620f6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:48.750495 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4fd2-e112-44a8-b220-a5b0cfb620f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:48.767649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1e6a4fd2-e112-44a8-b220-a5b0cfb620f6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:48.768820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1e6a4fd2-e112-44a8-b220-a5b0cfb620f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:48.776624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:48.814214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38307053-64f2-4cfa-b04d-919a6dd1f737 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:48.824792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38307053-64f2-4cfa-b04d-919a6dd1f737 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:48.828267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6203953-d0e8-4f62-86b9-5061cd13a43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:48.828896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6203953-d0e8-4f62-86b9-5061cd13a43e service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:48.829180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6203953-d0e8-4f62-86b9-5061cd13a43e service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:48.829456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6203953-d0e8-4f62-86b9-5061cd13a43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:48.838321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6203953-d0e8-4f62-86b9-5061cd13a43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:48.839745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6203953-d0e8-4f62-86b9-5061cd13a43e service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:48.849203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 730/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:50.910400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cdf7f-adc5-4311-ad84-0027bd3601d6 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:50.910872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cdf7f-adc5-4311-ad84-0027bd3601d6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:50.917996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cdf7f-adc5-4311-ad84-0027bd3601d6 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:50.917996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:50.918203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259c978-afa9-487e-9404-4b238c60c24b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:50.918203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259c978-afa9-487e-9404-4b238c60c24b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:50.918203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259c978-afa9-487e-9404-4b238c60c24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:50.936522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4259c978-afa9-487e-9404-4b238c60c24b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:50.937721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4259c978-afa9-487e-9404-4b238c60c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:50.945413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:50.982358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cdf7f-adc5-4311-ad84-0027bd3601d6 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:50.993272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cdf7f-adc5-4311-ad84-0027bd3601d6 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:50.997021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ea00e-a983-4086-b114-a50ccd2f0060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:50.997688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ea00e-a983-4086-b114-a50ccd2f0060 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:50.998017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ea00e-a983-4086-b114-a50ccd2f0060 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:50.998299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ea00e-a983-4086-b114-a50ccd2f0060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:51.007800 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ea00e-a983-4086-b114-a50ccd2f0060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:51.009223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ea00e-a983-4086-b114-a50ccd2f0060 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:51.018640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 727/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:53.072783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35eb02-a96f-46ae-9263-329e9fcea560 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:53.073290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35eb02-a96f-46ae-9263-329e9fcea560 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:53.073402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35eb02-a96f-46ae-9263-329e9fcea560 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:53.074767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:53.080431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ddea1-2f9b-4c46-ae43-087e78f77d73 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:53.080856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ddea1-2f9b-4c46-ae43-087e78f77d73 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:53.080990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ddea1-2f9b-4c46-ae43-087e78f77d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:53.086965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=70 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:53.099680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1d6ddea1-2f9b-4c46-ae43-087e78f77d73 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:53.100868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1d6ddea1-2f9b-4c46-ae43-087e78f77d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:53.108702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:53.145658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35eb02-a96f-46ae-9263-329e9fcea560 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:53.151055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=73 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:53.157289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35eb02-a96f-46ae-9263-329e9fcea560 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:53.160882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44b551-ea0d-4f82-bfab-cda5c5518f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:53.161515 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44b551-ea0d-4f82-bfab-cda5c5518f79 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:53.161802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44b551-ea0d-4f82-bfab-cda5c5518f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:53.162147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44b551-ea0d-4f82-bfab-cda5c5518f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:53.171173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44b551-ea0d-4f82-bfab-cda5c5518f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:53.172646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44b551-ea0d-4f82-bfab-cda5c5518f79 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:53.182066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 733/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:55.238341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1aca-8550-4615-b998-f65b1ddff8ec None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:55.238866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1aca-8550-4615-b998-f65b1ddff8ec None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:55.238866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1aca-8550-4615-b998-f65b1ddff8ec None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:55.240210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:55.245376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024ebf8-c8cc-4afa-b2a6-ad17f48c64cc None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:55.245777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024ebf8-c8cc-4afa-b2a6-ad17f48c64cc None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:55.245954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024ebf8-c8cc-4afa-b2a6-ad17f48c64cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:55.264611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-6024ebf8-c8cc-4afa-b2a6-ad17f48c64cc None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:55.265786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6024ebf8-c8cc-4afa-b2a6-ad17f48c64cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:55.273664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:55.311914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea1aca-8550-4615-b998-f65b1ddff8ec None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:55.313666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c5ea1aca-8550-4615-b998-f65b1ddff8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:55.326423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea1aca-8550-4615-b998-f65b1ddff8ec None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:55.329846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a49bb-87a7-46c9-80d7-6a9a2b81f37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:55.330517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a49bb-87a7-46c9-80d7-6a9a2b81f37e service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:55.330804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a49bb-87a7-46c9-80d7-6a9a2b81f37e service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:55.331085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a49bb-87a7-46c9-80d7-6a9a2b81f37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:55.339778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a49bb-87a7-46c9-80d7-6a9a2b81f37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:55.341193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a49bb-87a7-46c9-80d7-6a9a2b81f37e service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:55.350716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 730/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:57.406629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b1b3e-c216-4bf8-9753-6b0c9a7321a1 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:57.407194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b1b3e-c216-4bf8-9753-6b0c9a7321a1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:57.407194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b1b3e-c216-4bf8-9753-6b0c9a7321a1 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:57.408565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:57.413750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84275fd-c23f-459b-90b7-617fe53713d3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:57.414264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84275fd-c23f-459b-90b7-617fe53713d3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:57.414394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84275fd-c23f-459b-90b7-617fe53713d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:57.432284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b84275fd-c23f-459b-90b7-617fe53713d3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:57.433466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b84275fd-c23f-459b-90b7-617fe53713d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:57.441146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:57.477348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b1b3e-c216-4bf8-9753-6b0c9a7321a1 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:57.488398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b1b3e-c216-4bf8-9753-6b0c9a7321a1 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:57.491868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb6c92-7734-49c2-8ffc-55b19b0a4584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:57.492496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb6c92-7734-49c2-8ffc-55b19b0a4584 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:57.492778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb6c92-7734-49c2-8ffc-55b19b0a4584 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:57.493054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb6c92-7734-49c2-8ffc-55b19b0a4584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:57.501780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb6c92-7734-49c2-8ffc-55b19b0a4584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:57.503226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb6c92-7734-49c2-8ffc-55b19b0a4584 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:57.512391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 736/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:59.535133 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383e41f-e901-4372-a6b7-7cf9e473de86 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:59.535722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383e41f-e901-4372-a6b7-7cf9e473de86 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:59.535722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383e41f-e901-4372-a6b7-7cf9e473de86 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:59.537057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:44:59.542189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d1e1-e60a-4587-9650-241fbc8c0cc4 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:59.542620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d1e1-e60a-4587-9650-241fbc8c0cc4 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:59.542737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d1e1-e60a-4587-9650-241fbc8c0cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:59.560086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4679d1e1-e60a-4587-9650-241fbc8c0cc4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:59.561781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4679d1e1-e60a-4587-9650-241fbc8c0cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:59.569401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:59.605295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383e41f-e901-4372-a6b7-7cf9e473de86 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:59.615805 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383e41f-e901-4372-a6b7-7cf9e473de86 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:59.619279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88981fd0-43fc-4695-8ac8-02165bf8be13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:59.619910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981fd0-43fc-4695-8ac8-02165bf8be13 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:59.620203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981fd0-43fc-4695-8ac8-02165bf8be13 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:59.620483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981fd0-43fc-4695-8ac8-02165bf8be13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:59.630100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88981fd0-43fc-4695-8ac8-02165bf8be13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:59.631558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88981fd0-43fc-4695-8ac8-02165bf8be13 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:59.641394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 733/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:09.555038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=17 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:09.636587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=17 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:19.368963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad01d15-10b3-4a37-aaba-268b0d5dbf95 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:19.369562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad01d15-10b3-4a37-aaba-268b0d5dbf95 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:19.369562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad01d15-10b3-4a37-aaba-268b0d5dbf95 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:19.370918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 738/1471] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:19.377031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15ea8-64e4-4cee-bfe1-027b45fe85d9 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:19.377489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15ea8-64e4-4cee-bfe1-027b45fe85d9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:19.377610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15ea8-64e4-4cee-bfe1-027b45fe85d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:19.394841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-d5d15ea8-64e4-4cee-bfe1-027b45fe85d9 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:19.396027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d5d15ea8-64e4-4cee-bfe1-027b45fe85d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:19.403933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 734/1472] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:19.451318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018d833-e4ca-424e-9655-7dcf8359d724 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:19.451613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018d833-e4ca-424e-9655-7dcf8359d724 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:19.451895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018d833-e4ca-424e-9655-7dcf8359d724 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:19.453293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 739/1473] 10.222.0.26 () {54 vars in 962 bytes} [Thu Jun 30 10:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:19.458140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eb9ee-6274-4bc2-bfa0-766b06bd7bb2 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:19.458436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eb9ee-6274-4bc2-bfa0-766b06bd7bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:19.458722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eb9ee-6274-4bc2-bfa0-766b06bd7bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:19.476457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-565eb9ee-6274-4bc2-bfa0-766b06bd7bb2 None None] MFA Rules not processed for user `9e839d1074f24a5ba7a552472e167067`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:19.477634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-565eb9ee-6274-4bc2-bfa0-766b06bd7bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:19.484468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 735/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Jun 30 10:45:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:19.491670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018d833-e4ca-424e-9655-7dcf8359d724 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:19.502629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018d833-e4ca-424e-9655-7dcf8359d724 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:19.506084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855e1d-ce57-404e-8fd4-9972db6619e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e839d1074f24a5ba7a552472e167067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:19.506696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855e1d-ce57-404e-8fd4-9972db6619e5 service glance] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:19.506981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855e1d-ce57-404e-8fd4-9972db6619e5 service glance] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:19.507260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855e1d-ce57-404e-8fd4-9972db6619e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:19.515905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55855e1d-ce57-404e-8fd4-9972db6619e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:19.517321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55855e1d-ce57-404e-8fd4-9972db6619e5 service glance] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:19.526444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 740/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:21.628063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f233-c7e1-4f08-9772-3c082e10ff0e None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:21.628635 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f233-c7e1-4f08-9772-3c082e10ff0e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:21.628635 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f233-c7e1-4f08-9772-3c082e10ff0e None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:21.630073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 736/1476] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:21.635292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc71f8-8e76-4082-acc7-28c8731b9cf3 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:21.635702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc71f8-8e76-4082-acc7-28c8731b9cf3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:21.635960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc71f8-8e76-4082-acc7-28c8731b9cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:21.654526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4dbc71f8-8e76-4082-acc7-28c8731b9cf3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:21.655672 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4dbc71f8-8e76-4082-acc7-28c8731b9cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:21.663369 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 741/1477] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:21.686079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f233-c7e1-4f08-9772-3c082e10ff0e None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:21.698127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f233-c7e1-4f08-9772-3c082e10ff0e None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:21.703036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b55c9a-e536-403d-aa68-b05a818d40dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:21.703671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55c9a-e536-403d-aa68-b05a818d40dc admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:21.703953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55c9a-e536-403d-aa68-b05a818d40dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:21.704228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55c9a-e536-403d-aa68-b05a818d40dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:21.704961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b55c9a-e536-403d-aa68-b05a818d40dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:21.706759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING py.warnings [None req-98b55c9a-e536-403d-aa68-b05a818d40dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:45:21.706759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: warnings.warn(msg) Jun 30 10:45:21.706759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: Jun 30 10:45:21.707886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b55c9a-e536-403d-aa68-b05a818d40dc admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:21.727232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 737/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jun 30 10:45:21 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:45:23.759302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb4df3-acfa-4b22-92bd-d10a7a5fab60 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:23.759834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb4df3-acfa-4b22-92bd-d10a7a5fab60 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:23.759834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb4df3-acfa-4b22-92bd-d10a7a5fab60 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:23.761153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 742/1479] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:23.767000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ef7bb-004c-4cf3-8ead-153b122c2c53 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:23.767427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ef7bb-004c-4cf3-8ead-153b122c2c53 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:23.767571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ef7bb-004c-4cf3-8ead-153b122c2c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:23.785616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-301ef7bb-004c-4cf3-8ead-153b122c2c53 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:23.786857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-301ef7bb-004c-4cf3-8ead-153b122c2c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:23.794495 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 738/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:23.836821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb4df3-acfa-4b22-92bd-d10a7a5fab60 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:23.852083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb4df3-acfa-4b22-92bd-d10a7a5fab60 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:23.857698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48b83a-ba13-4054-a5c0-b5d269849153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:23.858363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b83a-ba13-4054-a5c0-b5d269849153 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:23.858652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b83a-ba13-4054-a5c0-b5d269849153 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:23.858926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b83a-ba13-4054-a5c0-b5d269849153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:23.867115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48b83a-ba13-4054-a5c0-b5d269849153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:23.868704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48b83a-ba13-4054-a5c0-b5d269849153 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:23.878051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 743/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:26.077846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef7ba-14bb-4a90-8c95-8fdc16e7b39c None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:26.078417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef7ba-14bb-4a90-8c95-8fdc16e7b39c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:26.078417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef7ba-14bb-4a90-8c95-8fdc16e7b39c None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:26.079825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 739/1482] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:26.085209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a96d55-811f-4c5c-8597-1f5b0202b245 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:26.085676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a96d55-811f-4c5c-8597-1f5b0202b245 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:26.085801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a96d55-811f-4c5c-8597-1f5b0202b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:26.103525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-42a96d55-811f-4c5c-8597-1f5b0202b245 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:26.104723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-42a96d55-811f-4c5c-8597-1f5b0202b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:26.113055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 744/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:26.148783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ef7ba-14bb-4a90-8c95-8fdc16e7b39c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:26.159685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ef7ba-14bb-4a90-8c95-8fdc16e7b39c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:26.163216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3469fbb-c3e8-4199-8e4a-603f39c59fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:26.163848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3469fbb-c3e8-4199-8e4a-603f39c59fec service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:26.164137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3469fbb-c3e8-4199-8e4a-603f39c59fec service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:26.164419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3469fbb-c3e8-4199-8e4a-603f39c59fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:26.173760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3469fbb-c3e8-4199-8e4a-603f39c59fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:26.175228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3469fbb-c3e8-4199-8e4a-603f39c59fec service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:26.185090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 740/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:28.286460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce093ae-ae28-45b6-a5f1-59d449ee6324 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:28.286987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce093ae-ae28-45b6-a5f1-59d449ee6324 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:28.287086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce093ae-ae28-45b6-a5f1-59d449ee6324 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:28.288431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 745/1485] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:28.293562 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda0420-c51f-4163-a44c-dc1582732fa4 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:28.293990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda0420-c51f-4163-a44c-dc1582732fa4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:28.294159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda0420-c51f-4163-a44c-dc1582732fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:28.311770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6cda0420-c51f-4163-a44c-dc1582732fa4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:28.312964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6cda0420-c51f-4163-a44c-dc1582732fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:28.320739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 741/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:28.359434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce093ae-ae28-45b6-a5f1-59d449ee6324 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:28.370163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce093ae-ae28-45b6-a5f1-59d449ee6324 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:28.373721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a5058-eac7-4f53-8fb4-ca7f27f3c904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:28.374386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a5058-eac7-4f53-8fb4-ca7f27f3c904 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:28.374677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a5058-eac7-4f53-8fb4-ca7f27f3c904 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:28.374955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a5058-eac7-4f53-8fb4-ca7f27f3c904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:28.383753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a5058-eac7-4f53-8fb4-ca7f27f3c904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:28.385195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a5058-eac7-4f53-8fb4-ca7f27f3c904 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:28.395189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 746/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:30.540167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc768e2f-72b5-4267-b7ed-f521be8f5f8e None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:30.540732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc768e2f-72b5-4267-b7ed-f521be8f5f8e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:30.540732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc768e2f-72b5-4267-b7ed-f521be8f5f8e None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:30.542135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 742/1488] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:45:30.547364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d57e0-7b48-4806-b8d6-d9487c28a55d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:30.547808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d57e0-7b48-4806-b8d6-d9487c28a55d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:30.547929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d57e0-7b48-4806-b8d6-d9487c28a55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:30.566843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3d5d57e0-7b48-4806-b8d6-d9487c28a55d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:30.568097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3d5d57e0-7b48-4806-b8d6-d9487c28a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:30.576640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 747/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:30.617418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc768e2f-72b5-4267-b7ed-f521be8f5f8e None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:30.628918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc768e2f-72b5-4267-b7ed-f521be8f5f8e None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:30.632657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93a234-cc23-4001-abb0-47c0d32e619e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:30.633479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93a234-cc23-4001-abb0-47c0d32e619e service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:30.633772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93a234-cc23-4001-abb0-47c0d32e619e service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:30.634086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93a234-cc23-4001-abb0-47c0d32e619e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:30.645544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93a234-cc23-4001-abb0-47c0d32e619e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:30.647030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93a234-cc23-4001-abb0-47c0d32e619e service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:30.657971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 743/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:45:33.028301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d1440-dcff-4330-bb5d-95dae4e17c97 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:33.028832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d1440-dcff-4330-bb5d-95dae4e17c97 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:33.032243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d1440-dcff-4330-bb5d-95dae4e17c97 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:33.032243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 748/1491] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jun 30 10:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:33.035575 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838e99-18fb-473f-81ea-95d7a7bd63f0 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:33.035974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838e99-18fb-473f-81ea-95d7a7bd63f0 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:33.036138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838e99-18fb-473f-81ea-95d7a7bd63f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:33.054240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-61838e99-18fb-473f-81ea-95d7a7bd63f0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:33.055496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-61838e99-18fb-473f-81ea-95d7a7bd63f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:33.063869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 744/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jun 30 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:33.101982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d1440-dcff-4330-bb5d-95dae4e17c97 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:33.112991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d1440-dcff-4330-bb5d-95dae4e17c97 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:33.116487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e2f29-3e5d-47c3-bce1-4c19eca50c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:33.117114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e2f29-3e5d-47c3-bce1-4c19eca50c0e service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:33.117400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e2f29-3e5d-47c3-bce1-4c19eca50c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:33.117684 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e2f29-3e5d-47c3-bce1-4c19eca50c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:33.127146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e2f29-3e5d-47c3-bce1-4c19eca50c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:33.128572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e2f29-3e5d-47c3-bce1-4c19eca50c0e service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:33.137968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 749/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:43.049075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=33 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:43.133784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=33 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:07.576731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690063-bd15-4007-bfb6-7fe82d88dd67 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:07.577364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690063-bd15-4007-bfb6-7fe82d88dd67 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:07.577364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690063-bd15-4007-bfb6-7fe82d88dd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:07.595597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e9690063-bd15-4007-bfb6-7fe82d88dd67 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:47:07.596790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e9690063-bd15-4007-bfb6-7fe82d88dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:47:07.605124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 745/1494] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:47:07.613148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0e6d-6538-45a8-a7c3-384c1fbe98d7 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:07.613618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0e6d-6538-45a8-a7c3-384c1fbe98d7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:07.613770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0e6d-6538-45a8-a7c3-384c1fbe98d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:07.631315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-94ff0e6d-6538-45a8-a7c3-384c1fbe98d7 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:47:07.632491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-94ff0e6d-6538-45a8-a7c3-384c1fbe98d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:47:07.640172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 750/1495] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:47:07.644522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690063-bd15-4007-bfb6-7fe82d88dd67 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:07.654653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690063-bd15-4007-bfb6-7fe82d88dd67 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:07.659075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:07.659730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:07.660018 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:07.660300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:07.661024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:47:07.661336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:07.662384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING py.warnings [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:47:07.662384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: warnings.warn(msg) Jun 30 10:47:07.662384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: Jun 30 10:47:07.663282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:07.675403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 746/1496] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:47:07.683344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff0e6d-6538-45a8-a7c3-384c1fbe98d7 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:07.693401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff0e6d-6538-45a8-a7c3-384c1fbe98d7 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:07.697918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a50636-e672-4dc3-a64b-205803e54cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:07.698590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a50636-e672-4dc3-a64b-205803e54cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:07.698879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a50636-e672-4dc3-a64b-205803e54cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:07.699157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a50636-e672-4dc3-a64b-205803e54cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:07.699855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a50636-e672-4dc3-a64b-205803e54cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:07.701622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: WARNING py.warnings [None req-97a50636-e672-4dc3-a64b-205803e54cc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:47:07.701622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: warnings.warn(msg) Jun 30 10:47:07.701622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: Jun 30 10:47:07.702862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a50636-e672-4dc3-a64b-205803e54cc9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:07.805642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 751/1497] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:47:07 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:47:07.809752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:07.819506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11372db0-07cd-476a-8725-57f1b0f53ac4 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:07.875484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b38f-79b6-454a-bee6-81330a37ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:07.876107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b38f-79b6-454a-bee6-81330a37ed9c admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:07.876402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b38f-79b6-454a-bee6-81330a37ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:07.876702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b38f-79b6-454a-bee6-81330a37ed9c admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:07.877392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6b38f-79b6-454a-bee6-81330a37ed9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:07.878471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING py.warnings [None req-17b6b38f-79b6-454a-bee6-81330a37ed9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:47:07.878471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: warnings.warn(msg) Jun 30 10:47:07.878471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: Jun 30 10:47:07.879699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6b38f-79b6-454a-bee6-81330a37ed9c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:07.954511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 747/1498] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:47:07 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:47:07.957882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a50636-e672-4dc3-a64b-205803e54cc9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:07.968746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a50636-e672-4dc3-a64b-205803e54cc9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:07.973556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929cd26-4c02-4718-94d3-f572806bff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:07.974285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929cd26-4c02-4718-94d3-f572806bff0d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:07.974576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929cd26-4c02-4718-94d3-f572806bff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:07.974861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929cd26-4c02-4718-94d3-f572806bff0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:07.975592 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929cd26-4c02-4718-94d3-f572806bff0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:07.976619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: WARNING py.warnings [None req-c929cd26-4c02-4718-94d3-f572806bff0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:47:07.976619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: warnings.warn(msg) Jun 30 10:47:07.976619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: Jun 30 10:47:07.977505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929cd26-4c02-4718-94d3-f572806bff0d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:07.990252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 752/1499] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:47:07.993965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b38f-79b6-454a-bee6-81330a37ed9c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:08.003754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b38f-79b6-454a-bee6-81330a37ed9c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:08.008449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e4490-1e91-4fb9-8f5b-1f207425986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:08.009100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e4490-1e91-4fb9-8f5b-1f207425986a admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.009391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e4490-1e91-4fb9-8f5b-1f207425986a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.009676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e4490-1e91-4fb9-8f5b-1f207425986a admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.010957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e4490-1e91-4fb9-8f5b-1f207425986a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:08.011965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING py.warnings [None req-fd4e4490-1e91-4fb9-8f5b-1f207425986a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:47:08.011965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: warnings.warn(msg) Jun 30 10:47:08.011965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: Jun 30 10:47:08.012862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e4490-1e91-4fb9-8f5b-1f207425986a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:08.027707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 748/1500] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:47:08.031706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929cd26-4c02-4718-94d3-f572806bff0d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:08.041452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929cd26-4c02-4718-94d3-f572806bff0d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:08.046113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a847d-29a7-417b-a66e-2f88d2475097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:08.046985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a847d-29a7-417b-a66e-2f88d2475097 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.047274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a847d-29a7-417b-a66e-2f88d2475097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.047559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a847d-29a7-417b-a66e-2f88d2475097 admin admin] PATH_INFO: `/v3/projects/00399ef407124ba68e1d944e327dad5a/users/0050ced31bd742db82e38b75d0970144/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.062174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a847d-29a7-417b-a66e-2f88d2475097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00399ef407124ba68e1d944e327dad5a, user_id=0050ced31bd742db82e38b75d0970144, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:08.066513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: WARNING py.warnings [None req-851a847d-29a7-417b-a66e-2f88d2475097 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:47:08.066513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: warnings.warn(msg) Jun 30 10:47:08.066513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: Jun 30 10:47:08.066513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a847d-29a7-417b-a66e-2f88d2475097 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:08.118261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 753/1501] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:47:08 2022] PUT /identity/v3/projects/00399ef407124ba68e1d944e327dad5a/users/0050ced31bd742db82e38b75d0970144/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:47:08.130582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2d7bb-826c-426f-ab6a-709be1b579f3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.130818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2d7bb-826c-426f-ab6a-709be1b579f3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.131103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2d7bb-826c-426f-ab6a-709be1b579f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.157652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-25a2d7bb-826c-426f-ab6a-709be1b579f3 None None] MFA Rules not processed for user `0050ced31bd742db82e38b75d0970144`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:47:08.158882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-25a2d7bb-826c-426f-ab6a-709be1b579f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:47:08.220997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 749/1502] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:47:08.234362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cfed5-0f27-4e49-8f48-4e90c5f39886 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.234657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cfed5-0f27-4e49-8f48-4e90c5f39886 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.234942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cfed5-0f27-4e49-8f48-4e90c5f39886 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.236306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 754/1503] 10.222.0.26 () {54 vars in 963 bytes} [Thu Jun 30 10:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:47:08.241104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c01647-67d7-44ba-bd8c-fb5502d3a062 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.241400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c01647-67d7-44ba-bd8c-fb5502d3a062 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.241684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c01647-67d7-44ba-bd8c-fb5502d3a062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.259127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c1c01647-67d7-44ba-bd8c-fb5502d3a062 None None] MFA Rules not processed for user `19fd3da30bdb477e99dbbc2f7075f161`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:47:08.260875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c1c01647-67d7-44ba-bd8c-fb5502d3a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:47:08.303187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:08.310821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 750/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Jun 30 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:47:08.318474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cfed5-0f27-4e49-8f48-4e90c5f39886 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:08.329876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cfed5-0f27-4e49-8f48-4e90c5f39886 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:08.333544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2348-36f6-42b3-9533-7448848f8b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:08.334225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2348-36f6-42b3-9533-7448848f8b30 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.340266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2348-36f6-42b3-9533-7448848f8b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.340266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2348-36f6-42b3-9533-7448848f8b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.343439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb2348-36f6-42b3-9533-7448848f8b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:08.345146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb2348-36f6-42b3-9533-7448848f8b30 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:08.354015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 755/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:47:08.404452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dbdb6-81c2-4370-8480-15d2f29b7329 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.404753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dbdb6-81c2-4370-8480-15d2f29b7329 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.405101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dbdb6-81c2-4370-8480-15d2f29b7329 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.406503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 751/1506] 10.222.0.26 () {52 vars in 829 bytes} [Thu Jun 30 10:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:47:08.410140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2348-36f6-42b3-9533-7448848f8b30 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:08.473036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2348-36f6-42b3-9533-7448848f8b30 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:08.477562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:08.478456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.478744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.479559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] PATH_INFO: `/v3/users/0050ced31bd742db82e38b75d0970144` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.480747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0050ced31bd742db82e38b75d0970144)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:08.481760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: WARNING py.warnings [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:47:08.481760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: warnings.warn(msg) Jun 30 10:47:08.481760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: Jun 30 10:47:08.483044 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:08.685924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0050ced31bd742db82e38b75d0970144'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:08.746475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0050ced31bd742db82e38b75d0970144'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:08.765210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0050ced31bd742db82e38b75d0970144'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:08.765962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0050ced31bd742db82e38b75d0970144'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:08.774358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:08.779407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0050ced31bd742db82e38b75d0970144'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:08.785354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 756/1507] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:47:08 2022] DELETE /identity/v3/users/0050ced31bd742db82e38b75d0970144 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:47:08.789689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4b908-18b8-43bf-a852-2b1e3f35b6da None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.790180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4b908-18b8-43bf-a852-2b1e3f35b6da None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.790324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4b908-18b8-43bf-a852-2b1e3f35b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.807485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a2f4b908-18b8-43bf-a852-2b1e3f35b6da None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:47:08.808681 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a2f4b908-18b8-43bf-a852-2b1e3f35b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:47:08.866134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 752/1508] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:47:08.875546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:08.876972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:47:08.934919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5a592-695d-45c9-a70d-a19cd4d7dbb4 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:08.938641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44ddef-04de-4f2a-aa25-498a03f81672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:08.939235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44ddef-04de-4f2a-aa25-498a03f81672 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:08.939524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44ddef-04de-4f2a-aa25-498a03f81672 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:08.939805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44ddef-04de-4f2a-aa25-498a03f81672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:08.949649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44ddef-04de-4f2a-aa25-498a03f81672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:08.951131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44ddef-04de-4f2a-aa25-498a03f81672 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:08.960568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 757/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:47:09.406150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4b908-18b8-43bf-a852-2b1e3f35b6da None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:47:09.407631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a2f4b908-18b8-43bf-a852-2b1e3f35b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:47:09.420379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4b908-18b8-43bf-a852-2b1e3f35b6da None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:47:09.425178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:47:09.426080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:09.426371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:09.426648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] PATH_INFO: `/v3/projects/00399ef407124ba68e1d944e327dad5a` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:09.427857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00399ef407124ba68e1d944e327dad5a)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:47:09.428861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING py.warnings [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:47:09.428861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: warnings.warn(msg) Jun 30 10:47:09.428861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: Jun 30 10:47:09.430097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:47:09.563094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00399ef407124ba68e1d944e327dad5a', 'request_id': 'req-39b3a523-18d4-4554-bc43-9956700f2e3f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:09.577678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00399ef407124ba68e1d944e327dad5a', 'request_id': 'req-39b3a523-18d4-4554-bc43-9956700f2e3f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:09.632857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00399ef407124ba68e1d944e327dad5a', 'request_id': 'req-39b3a523-18d4-4554-bc43-9956700f2e3f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:09.644308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] The token cache is being invalidate because project 00399ef407124ba68e1d944e327dad5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:47:09.644596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:09.645314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-39b3a523-18d4-4554-bc43-9956700f2e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:47:09.646889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 753/1510] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:47:09 2022] DELETE /identity/v3/projects/00399ef407124ba68e1d944e327dad5a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:47:18.956334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=29 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:19.641270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:56.409826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a7c9-4016-4f53-8200-b5b48877e691 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:56.410459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a7c9-4016-4f53-8200-b5b48877e691 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:56.410569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a7c9-4016-4f53-8200-b5b48877e691 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:56.412105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:48:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:48:56.417299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094387cd-ea01-48d0-a70f-f97e8377e41f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:56.417866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094387cd-ea01-48d0-a70f-f97e8377e41f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:56.417866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094387cd-ea01-48d0-a70f-f97e8377e41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:56.436046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-094387cd-ea01-48d0-a70f-f97e8377e41f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:56.437244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-094387cd-ea01-48d0-a70f-f97e8377e41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:56.496005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:48:56.648510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a7c9-4016-4f53-8200-b5b48877e691 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:56.650238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cf99a7c9-4016-4f53-8200-b5b48877e691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:56.727169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a7c9-4016-4f53-8200-b5b48877e691 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:56.732574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb586f-b369-44e5-ab21-60ed666dc78f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:56.733284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb586f-b369-44e5-ab21-60ed666dc78f service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:56.733587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb586f-b369-44e5-ab21-60ed666dc78f service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:56.733958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb586f-b369-44e5-ab21-60ed666dc78f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:56.743271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb586f-b369-44e5-ab21-60ed666dc78f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:56.744943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb586f-b369-44e5-ab21-60ed666dc78f service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:56.754754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 759/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:48:57.603294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b72e-8e54-4e1d-94f9-23751381abfa None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:57.603880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b72e-8e54-4e1d-94f9-23751381abfa None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:57.603880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b72e-8e54-4e1d-94f9-23751381abfa None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:57.605245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:48:57.610255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ed79-4d46-48cc-a5ad-e163e3f4819c None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:57.610658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ed79-4d46-48cc-a5ad-e163e3f4819c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:57.610821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ed79-4d46-48cc-a5ad-e163e3f4819c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:57.628519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4cf9ed79-4d46-48cc-a5ad-e163e3f4819c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:57.629732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4cf9ed79-4d46-48cc-a5ad-e163e3f4819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:57.638110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:48:57.787478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b72e-8e54-4e1d-94f9-23751381abfa None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:57.801661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b72e-8e54-4e1d-94f9-23751381abfa None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:57.807543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949265ff-adbf-489d-96cc-a6f48d7b959c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:57.808177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949265ff-adbf-489d-96cc-a6f48d7b959c service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:57.808465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949265ff-adbf-489d-96cc-a6f48d7b959c service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:57.808743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949265ff-adbf-489d-96cc-a6f48d7b959c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:57.816695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949265ff-adbf-489d-96cc-a6f48d7b959c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:57.818329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949265ff-adbf-489d-96cc-a6f48d7b959c service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:57.828197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 756/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:48:58.483800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba3378-b826-4d1b-9e05-91fc311c6203 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.484091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba3378-b826-4d1b-9e05-91fc311c6203 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.484369 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba3378-b826-4d1b-9e05-91fc311c6203 None None] PATH_INFO: `/v3` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.485699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 761/1517] 10.222.0.50 () {54 vars in 925 bytes} [Thu Jun 30 10:48:58 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:48:58.499118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07e2bb-5cf9-469f-bc96-ada566d9155f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.499413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07e2bb-5cf9-469f-bc96-ada566d9155f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.499697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07e2bb-5cf9-469f-bc96-ada566d9155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.519819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-bd07e2bb-5cf9-469f-bc96-ada566d9155f None None] MFA Rules not processed for user `3238a52a3f6047e0acb0136ab39257e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:58.521015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bd07e2bb-5cf9-469f-bc96-ada566d9155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:58.581358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 757/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Jun 30 10:48:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:02.586045 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54029-fffc-4690-a611-8b42042fa50e None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:02.586565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54029-fffc-4690-a611-8b42042fa50e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:02.586565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54029-fffc-4690-a611-8b42042fa50e None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:02.587873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 762/1519] 10.222.0.26 () {54 vars in 960 bytes} [Thu Jun 30 10:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:49:02.592947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42190abb-af25-47a5-9fde-0b3c2e9e7238 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:02.593358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42190abb-af25-47a5-9fde-0b3c2e9e7238 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:02.593516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42190abb-af25-47a5-9fde-0b3c2e9e7238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:02.611581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-42190abb-af25-47a5-9fde-0b3c2e9e7238 None None] MFA Rules not processed for user `3238a52a3f6047e0acb0136ab39257e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:02.612761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-42190abb-af25-47a5-9fde-0b3c2e9e7238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:02.621114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 758/1520] 10.222.0.26 () {58 vars in 1057 bytes} [Thu Jun 30 10:49:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:02.628581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54029-fffc-4690-a611-8b42042fa50e None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:02.642322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54029-fffc-4690-a611-8b42042fa50e None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:02.647249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312ddc8-c84d-472d-b1ac-a0105a63960c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3238a52a3f6047e0acb0136ab39257e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:02.648516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ddc8-c84d-472d-b1ac-a0105a63960c service placement] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:02.648812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ddc8-c84d-472d-b1ac-a0105a63960c service placement] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:02.649095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ddc8-c84d-472d-b1ac-a0105a63960c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:02.657211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ddc8-c84d-472d-b1ac-a0105a63960c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:02.658867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ddc8-c84d-472d-b1ac-a0105a63960c service placement] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:02.668440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 763/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:49:09.064952 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4309836-b07c-4521-95b6-5585aa11dadb None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:09.065488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4309836-b07c-4521-95b6-5585aa11dadb None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:09.065604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4309836-b07c-4521-95b6-5585aa11dadb None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:09.066958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:49:09.072471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5146-5a04-48a7-b43e-53b7df864174 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:09.072900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5146-5a04-48a7-b43e-53b7df864174 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:09.073018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5146-5a04-48a7-b43e-53b7df864174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:09.090349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-dc0f5146-5a04-48a7-b43e-53b7df864174 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:09.091523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-dc0f5146-5a04-48a7-b43e-53b7df864174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:09.099346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:09.251528 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4309836-b07c-4521-95b6-5585aa11dadb None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:09.266356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4309836-b07c-4521-95b6-5585aa11dadb None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:09.271749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aefb9-b711-4c95-9aee-7b2df68797e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:09.272413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aefb9-b711-4c95-9aee-7b2df68797e4 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:09.272755 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aefb9-b711-4c95-9aee-7b2df68797e4 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:09.273019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aefb9-b711-4c95-9aee-7b2df68797e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:09.281038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255aefb9-b711-4c95-9aee-7b2df68797e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:09.282678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255aefb9-b711-4c95-9aee-7b2df68797e4 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:09.292024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 760/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:10.104347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce44bd-5935-4b8b-b825-422d2b232f6e None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:10.104911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce44bd-5935-4b8b-b825-422d2b232f6e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:10.104911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce44bd-5935-4b8b-b825-422d2b232f6e None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:10.106318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:49:10.111185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a4f66-06dd-48f7-8366-9b32573d7413 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:10.111602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a4f66-06dd-48f7-8366-9b32573d7413 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:10.111748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a4f66-06dd-48f7-8366-9b32573d7413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:10.129600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-474a4f66-06dd-48f7-8366-9b32573d7413 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:10.130740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-474a4f66-06dd-48f7-8366-9b32573d7413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:10.139243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:10.291867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce44bd-5935-4b8b-b825-422d2b232f6e None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:10.305980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce44bd-5935-4b8b-b825-422d2b232f6e None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:10.311334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44752fb-8647-4b01-8647-21867653060c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:10.311964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44752fb-8647-4b01-8647-21867653060c service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:10.312253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44752fb-8647-4b01-8647-21867653060c service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:10.312535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44752fb-8647-4b01-8647-21867653060c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:10.321023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44752fb-8647-4b01-8647-21867653060c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:10.322648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44752fb-8647-4b01-8647-21867653060c service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:10.331843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 766/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:14.315762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dcf2d-de6f-4ff8-b9ba-cc01c9ad1336 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:14.316384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dcf2d-de6f-4ff8-b9ba-cc01c9ad1336 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:14.316384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dcf2d-de6f-4ff8-b9ba-cc01c9ad1336 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:14.317694 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:49:14.323017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37170b85-1621-4097-8b93-00db4a8cc915 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:14.323469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37170b85-1621-4097-8b93-00db4a8cc915 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:14.323580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37170b85-1621-4097-8b93-00db4a8cc915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:14.341502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-37170b85-1621-4097-8b93-00db4a8cc915 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:14.343023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-37170b85-1621-4097-8b93-00db4a8cc915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:14.350557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:14.386450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dcf2d-de6f-4ff8-b9ba-cc01c9ad1336 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:14.388127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d91dcf2d-de6f-4ff8-b9ba-cc01c9ad1336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:14.444751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dcf2d-de6f-4ff8-b9ba-cc01c9ad1336 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:14.448309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a56e2-32ad-4630-bbc2-fabc23edaa3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:14.448949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a56e2-32ad-4630-bbc2-fabc23edaa3f service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:14.449235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a56e2-32ad-4630-bbc2-fabc23edaa3f service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:14.449517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a56e2-32ad-4630-bbc2-fabc23edaa3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:14.458352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a56e2-32ad-4630-bbc2-fabc23edaa3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:14.459770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a56e2-32ad-4630-bbc2-fabc23edaa3f service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:14.465153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:14.470005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 763/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:16.482737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a042f-d4b8-4a67-acdb-20238a658e52 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.483320 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a042f-d4b8-4a67-acdb-20238a658e52 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.483320 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a042f-d4b8-4a67-acdb-20238a658e52 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.484697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:49:16.490006 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc31ae-2695-4698-bdda-2fbd4be1dba5 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.490438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc31ae-2695-4698-bdda-2fbd4be1dba5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.490590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc31ae-2695-4698-bdda-2fbd4be1dba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.508551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-59cc31ae-2695-4698-bdda-2fbd4be1dba5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:16.509773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-59cc31ae-2695-4698-bdda-2fbd4be1dba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:16.517407 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:16.553758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a042f-d4b8-4a67-acdb-20238a658e52 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.564703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a042f-d4b8-4a67-acdb-20238a658e52 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.568185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c93f5-1157-450b-9c24-461b9bda90d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.568813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c93f5-1157-450b-9c24-461b9bda90d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.569099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c93f5-1157-450b-9c24-461b9bda90d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.569374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c93f5-1157-450b-9c24-461b9bda90d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.578404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c93f5-1157-450b-9c24-461b9bda90d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.579827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c93f5-1157-450b-9c24-461b9bda90d3 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.589656 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 769/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:20.203573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563451-c355-4cfa-b864-e053a7f782ea None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:20.204126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563451-c355-4cfa-b864-e053a7f782ea None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:20.204126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563451-c355-4cfa-b864-e053a7f782ea None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:20.205518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:49:20.211417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9bf49-5807-4b85-b358-c3392bcf5560 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:20.211846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9bf49-5807-4b85-b358-c3392bcf5560 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:20.211973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9bf49-5807-4b85-b358-c3392bcf5560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:20.218465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=62 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:20.230519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-77e9bf49-5807-4b85-b358-c3392bcf5560 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:20.231707 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-77e9bf49-5807-4b85-b358-c3392bcf5560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:20.239494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:20.538937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563451-c355-4cfa-b864-e053a7f782ea None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:20.540652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9c563451-c355-4cfa-b864-e053a7f782ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:20.598205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563451-c355-4cfa-b864-e053a7f782ea None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:20.602223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d893c-f66c-4ac6-9be3-a28d77be5dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:20.602862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d893c-f66c-4ac6-9be3-a28d77be5dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:20.603146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d893c-f66c-4ac6-9be3-a28d77be5dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:20.603420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d893c-f66c-4ac6-9be3-a28d77be5dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:20.612180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d893c-f66c-4ac6-9be3-a28d77be5dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:20.613595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d893c-f66c-4ac6-9be3-a28d77be5dd9 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:20.623356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 766/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:49:22.703844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea35c-4ee6-4598-91a3-0c1ab58a4fc9 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.708425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea35c-4ee6-4598-91a3-0c1ab58a4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.708425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea35c-4ee6-4598-91a3-0c1ab58a4fc9 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.708425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:49:22.711522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d43a3-d281-4407-a774-b665a9a6dc38 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.711910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d43a3-d281-4407-a774-b665a9a6dc38 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.712091 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d43a3-d281-4407-a774-b665a9a6dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.730639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c27d43a3-d281-4407-a774-b665a9a6dc38 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:22.731848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c27d43a3-d281-4407-a774-b665a9a6dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:22.739677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:23.040889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea35c-4ee6-4598-91a3-0c1ab58a4fc9 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.042610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b2eea35c-4ee6-4598-91a3-0c1ab58a4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:23.055544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea35c-4ee6-4598-91a3-0c1ab58a4fc9 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.059033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a32e1-6285-4d21-94ff-3b8ee1eb6dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.059667 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a32e1-6285-4d21-94ff-3b8ee1eb6dca service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.059955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a32e1-6285-4d21-94ff-3b8ee1eb6dca service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.060234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a32e1-6285-4d21-94ff-3b8ee1eb6dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.069025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a32e1-6285-4d21-94ff-3b8ee1eb6dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.071002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a32e1-6285-4d21-94ff-3b8ee1eb6dca service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.080328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 772/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:32.724912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=32 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:33.076225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=8 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:57.674913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7605c0-54b0-45d5-83cf-03e977fd7b92 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:57.675584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7605c0-54b0-45d5-83cf-03e977fd7b92 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:57.675584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7605c0-54b0-45d5-83cf-03e977fd7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:57.700385 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3e7605c0-54b0-45d5-83cf-03e977fd7b92 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:57.701675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3e7605c0-54b0-45d5-83cf-03e977fd7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:57.715468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 768/1540] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:57.724749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aabd7-7beb-407a-a250-1be2b1923c11 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:57.725336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aabd7-7beb-407a-a250-1be2b1923c11 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:57.725336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aabd7-7beb-407a-a250-1be2b1923c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:57.752474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-826aabd7-7beb-407a-a250-1be2b1923c11 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:57.753710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-826aabd7-7beb-407a-a250-1be2b1923c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:57.766061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 773/1541] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:57.771606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7605c0-54b0-45d5-83cf-03e977fd7b92 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:57.777084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a364f75-6941-40c9-ae92-fbbed3ebc7e8 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:57.777466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a364f75-6941-40c9-ae92-fbbed3ebc7e8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:57.777669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a364f75-6941-40c9-ae92-fbbed3ebc7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:57.783612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7605c0-54b0-45d5-83cf-03e977fd7b92 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:57.794345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe9e73-6d4c-45d0-9a65-0bb67f79ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:57.795088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe9e73-6d4c-45d0-9a65-0bb67f79ce97 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:57.795375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe9e73-6d4c-45d0-9a65-0bb67f79ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:57.795651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe9e73-6d4c-45d0-9a65-0bb67f79ce97 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:57.796396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe9e73-6d4c-45d0-9a65-0bb67f79ce97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:50:57.796706 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe9e73-6d4c-45d0-9a65-0bb67f79ce97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:57.798435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe9e73-6d4c-45d0-9a65-0bb67f79ce97 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:57.810999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-5a364f75-6941-40c9-ae92-fbbed3ebc7e8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:57.812568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5a364f75-6941-40c9-ae92-fbbed3ebc7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:57.816944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 769/1542] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:50:57.825335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe9e73-6d4c-45d0-9a65-0bb67f79ce97 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:57.826797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 774/1543] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:50:57.835891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd97bb-77a6-496c-8195-5be3af0d7e39 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:57.836196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd97bb-77a6-496c-8195-5be3af0d7e39 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:57.836471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd97bb-77a6-496c-8195-5be3af0d7e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:57.837014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe9e73-6d4c-45d0-9a65-0bb67f79ce97 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:57.847724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abcbf4-f2da-473b-974d-ffb4a0b9eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:57.848392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abcbf4-f2da-473b-974d-ffb4a0b9eb38 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:57.848678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abcbf4-f2da-473b-974d-ffb4a0b9eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:57.849582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abcbf4-f2da-473b-974d-ffb4a0b9eb38 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:57.850306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abcbf4-f2da-473b-974d-ffb4a0b9eb38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:57.851333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING py.warnings [None req-97abcbf4-f2da-473b-974d-ffb4a0b9eb38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:50:57.851333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: warnings.warn(msg) Jun 30 10:50:57.851333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: Jun 30 10:50:57.852821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abcbf4-f2da-473b-974d-ffb4a0b9eb38 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:57.884930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f9fd97bb-77a6-496c-8195-5be3af0d7e39 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:57.886214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f9fd97bb-77a6-496c-8195-5be3af0d7e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:57.912313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 775/1544] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:50:57.916705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd97bb-77a6-496c-8195-5be3af0d7e39 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:57.930984 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd97bb-77a6-496c-8195-5be3af0d7e39 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:57.938563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771c676-f3e6-4a0d-81ff-a9ead6fba468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:57.944361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c676-f3e6-4a0d-81ff-a9ead6fba468 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:57.944361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c676-f3e6-4a0d-81ff-a9ead6fba468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:57.944361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c676-f3e6-4a0d-81ff-a9ead6fba468 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:57.944361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771c676-f3e6-4a0d-81ff-a9ead6fba468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:50:57.944361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771c676-f3e6-4a0d-81ff-a9ead6fba468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:57.944791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: WARNING py.warnings [None req-1771c676-f3e6-4a0d-81ff-a9ead6fba468 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:50:57.944791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: warnings.warn(msg) Jun 30 10:50:57.944791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: Jun 30 10:50:57.944791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771c676-f3e6-4a0d-81ff-a9ead6fba468 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:57.960541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 776/1545] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:50:57.962027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4af5b-a2b3-4a7f-8bc1-3890473e3fc0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:57.962325 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4af5b-a2b3-4a7f-8bc1-3890473e3fc0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:57.962611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4af5b-a2b3-4a7f-8bc1-3890473e3fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:57.985773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c2c4af5b-a2b3-4a7f-8bc1-3890473e3fc0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:57.986051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 770/1546] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:50:57 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:50:57.986937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abcbf4-f2da-473b-974d-ffb4a0b9eb38 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:57.987139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c2c4af5b-a2b3-4a7f-8bc1-3890473e3fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.086217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 777/1547] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.087027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4af5b-a2b3-4a7f-8bc1-3890473e3fc0 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.100794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4af5b-a2b3-4a7f-8bc1-3890473e3fc0 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.106898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abcbf4-f2da-473b-974d-ffb4a0b9eb38 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.110881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c721a-b106-48c4-aa78-de7d2ea91a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.111844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c721a-b106-48c4-aa78-de7d2ea91a42 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.112772 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c721a-b106-48c4-aa78-de7d2ea91a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.113781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c721a-b106-48c4-aa78-de7d2ea91a42 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.115041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c721a-b106-48c4-aa78-de7d2ea91a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.116751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: WARNING py.warnings [None req-c61c721a-b106-48c4-aa78-de7d2ea91a42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:50:58.116751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: warnings.warn(msg) Jun 30 10:50:58.116751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: Jun 30 10:50:58.118872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c721a-b106-48c4-aa78-de7d2ea91a42 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.124551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060a14-11d4-4a7c-bded-5539b45f6ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.125560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060a14-11d4-4a7c-bded-5539b45f6ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.126097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060a14-11d4-4a7c-bded-5539b45f6ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.126610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060a14-11d4-4a7c-bded-5539b45f6ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.127510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060a14-11d4-4a7c-bded-5539b45f6ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.129653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060a14-11d4-4a7c-bded-5539b45f6ed0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.196969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 778/1548] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:58.198261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac5274-66e2-4e50-b190-2f6bc5b566c0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.198555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac5274-66e2-4e50-b190-2f6bc5b566c0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.198836 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac5274-66e2-4e50-b190-2f6bc5b566c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.215546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 771/1549] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:50:57 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:58.216917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35101140-7e6a-4b3c-95b0-f647b4fdfec1 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.219128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35101140-7e6a-4b3c-95b0-f647b4fdfec1 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.219128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35101140-7e6a-4b3c-95b0-f647b4fdfec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.219507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1cac5274-66e2-4e50-b190-2f6bc5b566c0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.219507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1cac5274-66e2-4e50-b190-2f6bc5b566c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.236625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-35101140-7e6a-4b3c-95b0-f647b4fdfec1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.238358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-35101140-7e6a-4b3c-95b0-f647b4fdfec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.278705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 779/1550] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.280227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefffe6-2090-4eed-8496-dbcec61370ba None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.280519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefffe6-2090-4eed-8496-dbcec61370ba None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.280799 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefffe6-2090-4eed-8496-dbcec61370ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.298464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3fefffe6-2090-4eed-8496-dbcec61370ba None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.299674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3fefffe6-2090-4eed-8496-dbcec61370ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.300905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 772/1551] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.306109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde2e20-0685-43c3-b4a3-3d74aa003769 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.306109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde2e20-0685-43c3-b4a3-3d74aa003769 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.306109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde2e20-0685-43c3-b4a3-3d74aa003769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.312578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 780/1552] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.313882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2cebe-1eca-4071-82d7-da0e72e665c4 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.314207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2cebe-1eca-4071-82d7-da0e72e665c4 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.314483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2cebe-1eca-4071-82d7-da0e72e665c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.323330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3bde2e20-0685-43c3-b4a3-3d74aa003769 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.324522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3bde2e20-0685-43c3-b4a3-3d74aa003769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.331948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b9f2cebe-1eca-4071-82d7-da0e72e665c4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.332605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 773/1553] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.333184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b9f2cebe-1eca-4071-82d7-da0e72e665c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.335798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429601c0-47c8-40bd-ba16-040afcc7ab4b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.336099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429601c0-47c8-40bd-ba16-040afcc7ab4b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.336503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429601c0-47c8-40bd-ba16-040afcc7ab4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.341956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 781/1554] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.342735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2cebe-1eca-4071-82d7-da0e72e665c4 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.352213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2cebe-1eca-4071-82d7-da0e72e665c4 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.355484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-429601c0-47c8-40bd-ba16-040afcc7ab4b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.356684 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b12a-3a39-468a-b48a-350b6f2a024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.356825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-429601c0-47c8-40bd-ba16-040afcc7ab4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.357330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b12a-3a39-468a-b48a-350b6f2a024f admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.357613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b12a-3a39-468a-b48a-350b6f2a024f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.357886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b12a-3a39-468a-b48a-350b6f2a024f admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.358655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b12a-3a39-468a-b48a-350b6f2a024f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.360254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b12a-3a39-468a-b48a-350b6f2a024f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.365175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 774/1555] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.365932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429601c0-47c8-40bd-ba16-040afcc7ab4b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.370876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 782/1556] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:50:58.372324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3017bc4-47c9-4c79-81f4-be093c9c5ade None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.372455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3017bc4-47c9-4c79-81f4-be093c9c5ade None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.372623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3017bc4-47c9-4c79-81f4-be093c9c5ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.378861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429601c0-47c8-40bd-ba16-040afcc7ab4b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.383902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5535d5-3e74-4910-97a3-9b10822091c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.384561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5535d5-3e74-4910-97a3-9b10822091c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.384844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5535d5-3e74-4910-97a3-9b10822091c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.385119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5535d5-3e74-4910-97a3-9b10822091c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.386042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5535d5-3e74-4910-97a3-9b10822091c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.388040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5535d5-3e74-4910-97a3-9b10822091c6 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.391498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-e3017bc4-47c9-4c79-81f4-be093c9c5ade None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.392691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e3017bc4-47c9-4c79-81f4-be093c9c5ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.400669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 783/1557] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.401986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1a134-75b8-4a53-952e-70ac1f32d7a6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.402294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1a134-75b8-4a53-952e-70ac1f32d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.402584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1a134-75b8-4a53-952e-70ac1f32d7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.420008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-02e1a134-75b8-4a53-952e-70ac1f32d7a6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.421196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-02e1a134-75b8-4a53-952e-70ac1f32d7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.429626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 784/1558] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.431418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1a134-75b8-4a53-952e-70ac1f32d7a6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.439653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1a134-75b8-4a53-952e-70ac1f32d7a6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.444948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6ad3-ea46-4312-934a-24a2a205c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.445572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6ad3-ea46-4312-934a-24a2a205c9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.445863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6ad3-ea46-4312-934a-24a2a205c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.446192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6ad3-ea46-4312-934a-24a2a205c9c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.446960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb6ad3-ea46-4312-934a-24a2a205c9c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:50:58.447354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb6ad3-ea46-4312-934a-24a2a205c9c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.448911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb6ad3-ea46-4312-934a-24a2a205c9c6 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.457441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:58.460634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 785/1559] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:50:58.462040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c9c4c-5bfe-45e3-bf84-38536b387045 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.462335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c9c4c-5bfe-45e3-bf84-38536b387045 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.462620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c9c4c-5bfe-45e3-bf84-38536b387045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.481363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ea3c9c4c-5bfe-45e3-bf84-38536b387045 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.482632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ea3c9c4c-5bfe-45e3-bf84-38536b387045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.485863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 775/1560] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:58.485863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ab740-046f-4023-956d-fd4454bc870d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.485863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ab740-046f-4023-956d-fd4454bc870d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.485863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ab740-046f-4023-956d-fd4454bc870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.491608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 786/1561] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.493080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2888-63ec-4212-9fc3-6c4b86c595b1 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.493368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2888-63ec-4212-9fc3-6c4b86c595b1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.493648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2888-63ec-4212-9fc3-6c4b86c595b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.504225 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e04ab740-046f-4023-956d-fd4454bc870d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.509204 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e04ab740-046f-4023-956d-fd4454bc870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.512169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f1ab2888-63ec-4212-9fc3-6c4b86c595b1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:58.513375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f1ab2888-63ec-4212-9fc3-6c4b86c595b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:58.514019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 776/1562] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.517745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ab740-046f-4023-956d-fd4454bc870d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.521778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 787/1563] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:58.522590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab2888-63ec-4212-9fc3-6c4b86c595b1 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.527958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ab740-046f-4023-956d-fd4454bc870d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.532155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab2888-63ec-4212-9fc3-6c4b86c595b1 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.532548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817f816-c919-4d9f-96a2-385eb75d8234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.533303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817f816-c919-4d9f-96a2-385eb75d8234 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.533590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817f816-c919-4d9f-96a2-385eb75d8234 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.533873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817f816-c919-4d9f-96a2-385eb75d8234 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.534653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817f816-c919-4d9f-96a2-385eb75d8234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.536291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817f816-c919-4d9f-96a2-385eb75d8234 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.536855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ed96-6f98-4b33-a241-c2cc3d463cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.537504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ed96-6f98-4b33-a241-c2cc3d463cda admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.537657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:58.537779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ed96-6f98-4b33-a241-c2cc3d463cda admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.538100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ed96-6f98-4b33-a241-c2cc3d463cda admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.539006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ed96-6f98-4b33-a241-c2cc3d463cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:50:58.539345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ed96-6f98-4b33-a241-c2cc3d463cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.540949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ed96-6f98-4b33-a241-c2cc3d463cda admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.546776 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 777/1564] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:50:58.550883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817f816-c919-4d9f-96a2-385eb75d8234 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.553572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 788/1565] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:50:58.554603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ed96-6f98-4b33-a241-c2cc3d463cda admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.561111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817f816-c919-4d9f-96a2-385eb75d8234 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.566093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fab46-a11f-4389-b264-3e0cbe8b32bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.566660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fab46-a11f-4389-b264-3e0cbe8b32bb admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.566956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fab46-a11f-4389-b264-3e0cbe8b32bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.567242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fab46-a11f-4389-b264-3e0cbe8b32bb admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.568043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fab46-a11f-4389-b264-3e0cbe8b32bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:50:58.568355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fab46-a11f-4389-b264-3e0cbe8b32bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.570969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fab46-a11f-4389-b264-3e0cbe8b32bb admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.571762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ed96-6f98-4b33-a241-c2cc3d463cda admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.576501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18962f56-9417-4c6a-8443-3b04c4be0009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.577153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18962f56-9417-4c6a-8443-3b04c4be0009 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.577762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18962f56-9417-4c6a-8443-3b04c4be0009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.578995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18962f56-9417-4c6a-8443-3b04c4be0009 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.578995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18962f56-9417-4c6a-8443-3b04c4be0009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.580688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18962f56-9417-4c6a-8443-3b04c4be0009 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.583100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 778/1566] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:50:58.586931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fab46-a11f-4389-b264-3e0cbe8b32bb admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.597235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fab46-a11f-4389-b264-3e0cbe8b32bb admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.601855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7485-9556-4dcf-b52f-054962cc8b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.602594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7485-9556-4dcf-b52f-054962cc8b79 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.602890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7485-9556-4dcf-b52f-054962cc8b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.603171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7485-9556-4dcf-b52f-054962cc8b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.603897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a7485-9556-4dcf-b52f-054962cc8b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.605521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a7485-9556-4dcf-b52f-054962cc8b79 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.616126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 779/1567] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:50:58.620960 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7485-9556-4dcf-b52f-054962cc8b79 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.626501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7485-9556-4dcf-b52f-054962cc8b79 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.631652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e963-147e-4197-bdfc-748764e6ccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.632264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e963-147e-4197-bdfc-748764e6ccf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.632551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e963-147e-4197-bdfc-748764e6ccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.632819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e963-147e-4197-bdfc-748764e6ccf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.633531 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e963-147e-4197-bdfc-748764e6ccf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:50:58.633837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e963-147e-4197-bdfc-748764e6ccf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.635519 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e963-147e-4197-bdfc-748764e6ccf1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.647585 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 780/1568] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:50:58.648461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e963-147e-4197-bdfc-748764e6ccf1 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.657743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e963-147e-4197-bdfc-748764e6ccf1 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.662570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb1272-1817-4650-81cb-a91df0e306d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.663263 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb1272-1817-4650-81cb-a91df0e306d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.663506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb1272-1817-4650-81cb-a91df0e306d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.663816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb1272-1817-4650-81cb-a91df0e306d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.664520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb1272-1817-4650-81cb-a91df0e306d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:50:58.664829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb1272-1817-4650-81cb-a91df0e306d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.666408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb1272-1817-4650-81cb-a91df0e306d8 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.678490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 781/1569] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:50:58.679238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb1272-1817-4650-81cb-a91df0e306d8 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.685488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 789/1570] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:58.685488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18962f56-9417-4c6a-8443-3b04c4be0009 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.691217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb1272-1817-4650-81cb-a91df0e306d8 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.747482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc07e48-90dc-4e26-8ced-2cd3e974b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.748072 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc07e48-90dc-4e26-8ced-2cd3e974b264 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.748212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18962f56-9417-4c6a-8443-3b04c4be0009 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.748707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc07e48-90dc-4e26-8ced-2cd3e974b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.748707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc07e48-90dc-4e26-8ced-2cd3e974b264 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.749383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc07e48-90dc-4e26-8ced-2cd3e974b264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:50:58.749694 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc07e48-90dc-4e26-8ced-2cd3e974b264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.751321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc07e48-90dc-4e26-8ced-2cd3e974b264 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.752988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60471d-ed0b-46e1-a087-bfcff28e94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.753874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60471d-ed0b-46e1-a087-bfcff28e94e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.754201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60471d-ed0b-46e1-a087-bfcff28e94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.754604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60471d-ed0b-46e1-a087-bfcff28e94e4 admin admin] PATH_INFO: `/v3/projects/b5590986de0c4c1280ad211b617c813e/users/3f25b12a55804b1b904ab4d3afbc96a9/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.764953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 782/1571] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:50:58.765744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc07e48-90dc-4e26-8ced-2cd3e974b264 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.769929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60471d-ed0b-46e1-a087-bfcff28e94e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5590986de0c4c1280ad211b617c813e, user_id=3f25b12a55804b1b904ab4d3afbc96a9, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.772725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60471d-ed0b-46e1-a087-bfcff28e94e4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.775906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc07e48-90dc-4e26-8ced-2cd3e974b264 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.780382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd07e4e-f457-494c-bc30-bfdee7bce5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.781029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd07e4e-f457-494c-bc30-bfdee7bce5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.781316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd07e4e-f457-494c-bc30-bfdee7bce5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.781593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd07e4e-f457-494c-bc30-bfdee7bce5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.782300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd07e4e-f457-494c-bc30-bfdee7bce5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.784206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd07e4e-f457-494c-bc30-bfdee7bce5f9 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.865621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 790/1572] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:50:58 2022] PUT /identity/v3/projects/b5590986de0c4c1280ad211b617c813e/users/3f25b12a55804b1b904ab4d3afbc96a9/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:50:58.866479 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60471d-ed0b-46e1-a087-bfcff28e94e4 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.890582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 783/1573] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/projects => generated 355 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:58.891574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd07e4e-f457-494c-bc30-bfdee7bce5f9 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.936207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60471d-ed0b-46e1-a087-bfcff28e94e4 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.957415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd07e4e-f457-494c-bc30-bfdee7bce5f9 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.962382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f2a9-5a44-42a4-b21f-700146585d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.962750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f2a9-5a44-42a4-b21f-700146585d56 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.963038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f2a9-5a44-42a4-b21f-700146585d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.963321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f2a9-5a44-42a4-b21f-700146585d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.964053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f2a9-5a44-42a4-b21f-700146585d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.965957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f2a9-5a44-42a4-b21f-700146585d56 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.976327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 784/1574] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:50:58.977230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f2a9-5a44-42a4-b21f-700146585d56 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:58.980685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:58.988578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f2a9-5a44-42a4-b21f-700146585d56 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:58.993618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c3a74-ceff-4180-b13e-ac3e1f698575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.994280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c3a74-ceff-4180-b13e-ac3e1f698575 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.994488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feabff-5682-4587-9e0b-73b5d8f5911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:58.994608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c3a74-ceff-4180-b13e-ac3e1f698575 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.994841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c3a74-ceff-4180-b13e-ac3e1f698575 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.995521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c3a74-ceff-4180-b13e-ac3e1f698575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.995635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feabff-5682-4587-9e0b-73b5d8f5911d admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:58.995858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feabff-5682-4587-9e0b-73b5d8f5911d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:58.996147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feabff-5682-4587-9e0b-73b5d8f5911d admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:58.996841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9feabff-5682-4587-9e0b-73b5d8f5911d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:58.997403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c3a74-ceff-4180-b13e-ac3e1f698575 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:58.998841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9feabff-5682-4587-9e0b-73b5d8f5911d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.007868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:59.094523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 785/1575] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.095457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c3a74-ceff-4180-b13e-ac3e1f698575 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.127465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 791/1576] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:50:58 2022] POST /identity/v3/projects => generated 377 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.127465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feabff-5682-4587-9e0b-73b5d8f5911d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.156855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c3a74-ceff-4180-b13e-ac3e1f698575 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.185267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feabff-5682-4587-9e0b-73b5d8f5911d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.189816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097cab4-b6d7-4159-a36c-177d4a5a4d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.190522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097cab4-b6d7-4159-a36c-177d4a5a4d7a admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.190808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097cab4-b6d7-4159-a36c-177d4a5a4d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.191088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097cab4-b6d7-4159-a36c-177d4a5a4d7a admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.191777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097cab4-b6d7-4159-a36c-177d4a5a4d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.193863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097cab4-b6d7-4159-a36c-177d4a5a4d7a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.218291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3bba1-1838-496a-b9be-10c11cdb1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.218995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3bba1-1838-496a-b9be-10c11cdb1056 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.219290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3bba1-1838-496a-b9be-10c11cdb1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.220032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3bba1-1838-496a-b9be-10c11cdb1056 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.220266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3bba1-1838-496a-b9be-10c11cdb1056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.222811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3bba1-1838-496a-b9be-10c11cdb1056 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.305031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 792/1577] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.305847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097cab4-b6d7-4159-a36c-177d4a5a4d7a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.315720 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097cab4-b6d7-4159-a36c-177d4a5a4d7a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.319721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80a0be-b189-4dbf-8ab2-4dfee40990c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.320345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80a0be-b189-4dbf-8ab2-4dfee40990c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.320639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80a0be-b189-4dbf-8ab2-4dfee40990c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.320923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80a0be-b189-4dbf-8ab2-4dfee40990c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.321604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80a0be-b189-4dbf-8ab2-4dfee40990c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.323557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80a0be-b189-4dbf-8ab2-4dfee40990c6 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.335163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 786/1578] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.337435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df407-a5ab-4f6f-9373-38616f601db5 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.338788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df407-a5ab-4f6f-9373-38616f601db5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.338788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df407-a5ab-4f6f-9373-38616f601db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.368051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9f5df407-a5ab-4f6f-9373-38616f601db5 None None] MFA Rules not processed for user `3f25b12a55804b1b904ab4d3afbc96a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:59.369235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9f5df407-a5ab-4f6f-9373-38616f601db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:59.391595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 793/1579] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.392788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80a0be-b189-4dbf-8ab2-4dfee40990c6 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.436430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 787/1580] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:59.437283 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df407-a5ab-4f6f-9373-38616f601db5 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.451690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:59.461634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80a0be-b189-4dbf-8ab2-4dfee40990c6 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.467960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cbaf1-f50b-40fa-9e92-0cc9cd06dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.468619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cbaf1-f50b-40fa-9e92-0cc9cd06dd43 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.468936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cbaf1-f50b-40fa-9e92-0cc9cd06dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.469255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cbaf1-f50b-40fa-9e92-0cc9cd06dd43 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.469850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cbaf1-f50b-40fa-9e92-0cc9cd06dd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.471839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cbaf1-f50b-40fa-9e92-0cc9cd06dd43 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.502957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df407-a5ab-4f6f-9373-38616f601db5 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.507978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1883f16-e6c4-462b-b6b4-c9cd484be588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.508898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1883f16-e6c4-462b-b6b4-c9cd484be588 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.509183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1883f16-e6c4-462b-b6b4-c9cd484be588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.509463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1883f16-e6c4-462b-b6b4-c9cd484be588 admin admin] PATH_INFO: `/v3/projects/58aac7897501457a9469852ffcdcc29c/users/52599ae5d7a045e6b6156352322e5642/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.529647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1883f16-e6c4-462b-b6b4-c9cd484be588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58aac7897501457a9469852ffcdcc29c, user_id=52599ae5d7a045e6b6156352322e5642, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.530739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING py.warnings [None req-c1883f16-e6c4-462b-b6b4-c9cd484be588 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:50:59.530739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: warnings.warn(msg) Jun 30 10:50:59.530739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: Jun 30 10:50:59.532761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1883f16-e6c4-462b-b6b4-c9cd484be588 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.541971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 794/1581] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/users => generated 278 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.541971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cbaf1-f50b-40fa-9e92-0cc9cd06dd43 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.552120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cbaf1-f50b-40fa-9e92-0cc9cd06dd43 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.556920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8c6a-6ce4-43d8-96a1-9f2a3ec4b8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.557696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8c6a-6ce4-43d8-96a1-9f2a3ec4b8fa admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.558018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8c6a-6ce4-43d8-96a1-9f2a3ec4b8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.558303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8c6a-6ce4-43d8-96a1-9f2a3ec4b8fa admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.558991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a8c6a-6ce4-43d8-96a1-9f2a3ec4b8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.560978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a8c6a-6ce4-43d8-96a1-9f2a3ec4b8fa admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.637123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 788/1582] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:50:59 2022] PUT /identity/v3/projects/58aac7897501457a9469852ffcdcc29c/users/52599ae5d7a045e6b6156352322e5642/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:50:59.638024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1883f16-e6c4-462b-b6b4-c9cd484be588 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.666433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 795/1583] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.666433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8c6a-6ce4-43d8-96a1-9f2a3ec4b8fa admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.676626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8c6a-6ce4-43d8-96a1-9f2a3ec4b8fa admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.680431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:59.702808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1883f16-e6c4-462b-b6b4-c9cd484be588 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.707418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9337f-1a7a-4afc-b965-b348bc3aa4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.708814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9337f-1a7a-4afc-b965-b348bc3aa4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.709116 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9337f-1a7a-4afc-b965-b348bc3aa4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.709397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9337f-1a7a-4afc-b965-b348bc3aa4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.710132 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9337f-1a7a-4afc-b965-b348bc3aa4a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.712051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9337f-1a7a-4afc-b965-b348bc3aa4a5 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.734589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e23d-e8a4-4676-84b2-28be4f3380fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.735271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e23d-e8a4-4676-84b2-28be4f3380fb admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.735562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e23d-e8a4-4676-84b2-28be4f3380fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.735845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e23d-e8a4-4676-84b2-28be4f3380fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.736579 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8e23d-e8a4-4676-84b2-28be4f3380fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.738241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8e23d-e8a4-4676-84b2-28be4f3380fb admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.747985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 796/1584] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:50:59.748757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e23d-e8a4-4676-84b2-28be4f3380fb admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.758806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e23d-e8a4-4676-84b2-28be4f3380fb admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.763544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e852-ab2b-4f21-88d2-628fdb377373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.764197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e852-ab2b-4f21-88d2-628fdb377373 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.764485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e852-ab2b-4f21-88d2-628fdb377373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.764760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e852-ab2b-4f21-88d2-628fdb377373 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.765426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e852-ab2b-4f21-88d2-628fdb377373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.767357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e852-ab2b-4f21-88d2-628fdb377373 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.811031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 789/1585] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.811031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9337f-1a7a-4afc-b965-b348bc3aa4a5 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.818622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9337f-1a7a-4afc-b965-b348bc3aa4a5 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.823103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e31f8b-600d-4a59-b621-05c2819c5d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.823783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e31f8b-600d-4a59-b621-05c2819c5d9a admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.824070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e31f8b-600d-4a59-b621-05c2819c5d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.824352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e31f8b-600d-4a59-b621-05c2819c5d9a admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.825060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e31f8b-600d-4a59-b621-05c2819c5d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.827010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e31f8b-600d-4a59-b621-05c2819c5d9a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.888086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 797/1586] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.890413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b33cb8-04ef-4729-8f8e-b8d77e40099b None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.890715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b33cb8-04ef-4729-8f8e-b8d77e40099b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.891251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b33cb8-04ef-4729-8f8e-b8d77e40099b None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.892413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 798/1587] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 30 10:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:50:59.893192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b33cb8-04ef-4729-8f8e-b8d77e40099b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.906530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b33cb8-04ef-4729-8f8e-b8d77e40099b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.910773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 790/1588] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:50:59.916789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8388c-218c-4d50-bdc4-ef1e9d03d11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.916789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8388c-218c-4d50-bdc4-ef1e9d03d11e admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.916789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8388c-218c-4d50-bdc4-ef1e9d03d11e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.916789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8388c-218c-4d50-bdc4-ef1e9d03d11e admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.917159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435ec8d-e45d-4b71-ba67-9fb13d1c6785 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.917244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8388c-218c-4d50-bdc4-ef1e9d03d11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.917331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435ec8d-e45d-4b71-ba67-9fb13d1c6785 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.917331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435ec8d-e45d-4b71-ba67-9fb13d1c6785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.917491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8388c-218c-4d50-bdc4-ef1e9d03d11e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.925906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 799/1589] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:50:59.926629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8388c-218c-4d50-bdc4-ef1e9d03d11e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.934498 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b435ec8d-e45d-4b71-ba67-9fb13d1c6785 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:59.935711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b435ec8d-e45d-4b71-ba67-9fb13d1c6785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:59.936925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8388c-218c-4d50-bdc4-ef1e9d03d11e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.941545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf0ab7-ae7d-4d20-9dfa-bb0d861b113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.943648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf0ab7-ae7d-4d20-9dfa-bb0d861b113a admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.943648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf0ab7-ae7d-4d20-9dfa-bb0d861b113a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.943648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf0ab7-ae7d-4d20-9dfa-bb0d861b113a admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.944051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf0ab7-ae7d-4d20-9dfa-bb0d861b113a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.944179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 791/1590] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:59.944860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435ec8d-e45d-4b71-ba67-9fb13d1c6785 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.945645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf0ab7-ae7d-4d20-9dfa-bb0d861b113a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.954535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435ec8d-e45d-4b71-ba67-9fb13d1c6785 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.961031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 800/1591] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:50:59.961031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf0ab7-ae7d-4d20-9dfa-bb0d861b113a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.961285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd53a-09ed-4759-9d16-3436ac23191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.961285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd53a-09ed-4759-9d16-3436ac23191a admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.961285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd53a-09ed-4759-9d16-3436ac23191a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.961285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd53a-09ed-4759-9d16-3436ac23191a admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.961669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bd53a-09ed-4759-9d16-3436ac23191a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.962771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bd53a-09ed-4759-9d16-3436ac23191a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.970952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf0ab7-ae7d-4d20-9dfa-bb0d861b113a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.977719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 792/1592] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:50:59.977719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd53a-09ed-4759-9d16-3436ac23191a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:59.977992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bb131-562f-499a-8f86-5dd40b480d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.977992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bb131-562f-499a-8f86-5dd40b480d9e admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.978193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bb131-562f-499a-8f86-5dd40b480d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.978439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bb131-562f-499a-8f86-5dd40b480d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.979126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bb131-562f-499a-8f86-5dd40b480d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.980756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bb131-562f-499a-8f86-5dd40b480d9e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:59.985585 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd53a-09ed-4759-9d16-3436ac23191a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:59.990844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05364bc-6727-4bff-a54c-d8c773e37652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:59.991369 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 801/1593] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:50:59.991765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05364bc-6727-4bff-a54c-d8c773e37652 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.992057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05364bc-6727-4bff-a54c-d8c773e37652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.992336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05364bc-6727-4bff-a54c-d8c773e37652 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.992603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c5012-9d8b-4ae3-bca2-3a3b7b146208 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:59.992901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c5012-9d8b-4ae3-bca2-3a3b7b146208 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:59.993080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05364bc-6727-4bff-a54c-d8c773e37652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:59.993195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c5012-9d8b-4ae3-bca2-3a3b7b146208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:59.994786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05364bc-6727-4bff-a54c-d8c773e37652 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.006209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 793/1594] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:00.006868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05364bc-6727-4bff-a54c-d8c773e37652 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.011906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-213c5012-9d8b-4ae3-bca2-3a3b7b146208 None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:00.013143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-213c5012-9d8b-4ae3-bca2-3a3b7b146208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:00.016442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05364bc-6727-4bff-a54c-d8c773e37652 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.021063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c70cd-1bdc-4f81-b615-f203b8ee799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.021705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c70cd-1bdc-4f81-b615-f203b8ee799a admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.022019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c70cd-1bdc-4f81-b615-f203b8ee799a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.022298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c70cd-1bdc-4f81-b615-f203b8ee799a admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.023013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c70cd-1bdc-4f81-b615-f203b8ee799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.024584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c70cd-1bdc-4f81-b615-f203b8ee799a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.035335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 794/1595] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:00.036313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c70cd-1bdc-4f81-b615-f203b8ee799a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.045896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c70cd-1bdc-4f81-b615-f203b8ee799a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.050590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c325253-81f7-40a8-a80d-7abd5efc8e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.051230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325253-81f7-40a8-a80d-7abd5efc8e2d admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.051520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325253-81f7-40a8-a80d-7abd5efc8e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.052338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325253-81f7-40a8-a80d-7abd5efc8e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.053034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c325253-81f7-40a8-a80d-7abd5efc8e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.054676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c325253-81f7-40a8-a80d-7abd5efc8e2d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.064749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 795/1596] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:00.065470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c325253-81f7-40a8-a80d-7abd5efc8e2d admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.084522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:00.085470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 802/1597] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 30 10:50:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:00.086372 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c5012-9d8b-4ae3-bca2-3a3b7b146208 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.096893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c5012-9d8b-4ae3-bca2-3a3b7b146208 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.101804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318f85a-317a-4566-9018-b0f4d5daf731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.102490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318f85a-317a-4566-9018-b0f4d5daf731 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.102776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318f85a-317a-4566-9018-b0f4d5daf731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.103051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318f85a-317a-4566-9018-b0f4d5daf731 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.103812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318f85a-317a-4566-9018-b0f4d5daf731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.105451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318f85a-317a-4566-9018-b0f4d5daf731 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.119139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 803/1598] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:00.119139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318f85a-317a-4566-9018-b0f4d5daf731 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.120685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c325253-81f7-40a8-a80d-7abd5efc8e2d admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.124859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294bbd-56c5-4939-a190-20fd75a45c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.125693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294bbd-56c5-4939-a190-20fd75a45c81 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.125990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294bbd-56c5-4939-a190-20fd75a45c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.126663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294bbd-56c5-4939-a190-20fd75a45c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.130822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318f85a-317a-4566-9018-b0f4d5daf731 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.136863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9977f1f-c2a1-4f8b-98f4-0c7e80c104b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.138814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6294bbd-56c5-4939-a190-20fd75a45c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.138932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9977f1f-c2a1-4f8b-98f4-0c7e80c104b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.138932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9977f1f-c2a1-4f8b-98f4-0c7e80c104b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.138932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9977f1f-c2a1-4f8b-98f4-0c7e80c104b9 admin admin] PATH_INFO: `/v3/projects/813e7b66684f4431aa5724d04ab76fbd/users/60622199be2e44cd9c72f37c9d41e1b6/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.139400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6294bbd-56c5-4939-a190-20fd75a45c81 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.149349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 796/1599] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:00.151233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294bbd-56c5-4939-a190-20fd75a45c81 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.155453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9977f1f-c2a1-4f8b-98f4-0c7e80c104b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813e7b66684f4431aa5724d04ab76fbd, user_id=60622199be2e44cd9c72f37c9d41e1b6, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.158264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9977f1f-c2a1-4f8b-98f4-0c7e80c104b9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.162791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294bbd-56c5-4939-a190-20fd75a45c81 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.168784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0c2e-ff22-4ffc-a6c0-fb6b57730a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.169546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0c2e-ff22-4ffc-a6c0-fb6b57730a35 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.169839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0c2e-ff22-4ffc-a6c0-fb6b57730a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.170157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0c2e-ff22-4ffc-a6c0-fb6b57730a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.170927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb0c2e-ff22-4ffc-a6c0-fb6b57730a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.172760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb0c2e-ff22-4ffc-a6c0-fb6b57730a35 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.183652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 797/1600] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:00.184456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0c2e-ff22-4ffc-a6c0-fb6b57730a35 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.194287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0c2e-ff22-4ffc-a6c0-fb6b57730a35 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.198771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841afd-ae4c-4d31-91da-b15cb158fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.199399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841afd-ae4c-4d31-91da-b15cb158fe0c admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.199696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841afd-ae4c-4d31-91da-b15cb158fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.200035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841afd-ae4c-4d31-91da-b15cb158fe0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.200745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d841afd-ae4c-4d31-91da-b15cb158fe0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.202359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d841afd-ae4c-4d31-91da-b15cb158fe0c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.212180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 798/1601] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:00.212940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841afd-ae4c-4d31-91da-b15cb158fe0c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.224641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841afd-ae4c-4d31-91da-b15cb158fe0c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.225417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 804/1602] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:00 2022] PUT /identity/v3/projects/813e7b66684f4431aa5724d04ab76fbd/users/60622199be2e44cd9c72f37c9d41e1b6/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:00.226518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9977f1f-c2a1-4f8b-98f4-0c7e80c104b9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.237692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:00.290921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885cb21-fd18-40b0-9554-9fd3273f9cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.291623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885cb21-fd18-40b0-9554-9fd3273f9cda admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.291911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885cb21-fd18-40b0-9554-9fd3273f9cda admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.292191 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885cb21-fd18-40b0-9554-9fd3273f9cda admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.292932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885cb21-fd18-40b0-9554-9fd3273f9cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.294722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885cb21-fd18-40b0-9554-9fd3273f9cda admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.297788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9977f1f-c2a1-4f8b-98f4-0c7e80c104b9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.303608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6396364-8ca0-4854-ade0-3de8ad09927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.305925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6396364-8ca0-4854-ade0-3de8ad09927f admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.305925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6396364-8ca0-4854-ade0-3de8ad09927f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.305925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6396364-8ca0-4854-ade0-3de8ad09927f admin admin] PATH_INFO: `/v3/projects/4c50cda040184455943e248fe9727bd5/users/109d92580d6c4083baf480f944d51d4d/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.307062 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 799/1603] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:00.307855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885cb21-fd18-40b0-9554-9fd3273f9cda admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.324087 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6396364-8ca0-4854-ade0-3de8ad09927f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c50cda040184455943e248fe9727bd5, user_id=109d92580d6c4083baf480f944d51d4d, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.327152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6396364-8ca0-4854-ade0-3de8ad09927f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.390803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885cb21-fd18-40b0-9554-9fd3273f9cda admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.396594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace79f3a-4e44-4336-a544-023e8ffad705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.397255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace79f3a-4e44-4336-a544-023e8ffad705 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.397572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace79f3a-4e44-4336-a544-023e8ffad705 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.397830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace79f3a-4e44-4336-a544-023e8ffad705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.404444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 805/1604] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:00 2022] PUT /identity/v3/projects/4c50cda040184455943e248fe9727bd5/users/109d92580d6c4083baf480f944d51d4d/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:00.413060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6396364-8ca0-4854-ade0-3de8ad09927f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.453013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:00.484001 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace79f3a-4e44-4336-a544-023e8ffad705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.485541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace79f3a-4e44-4336-a544-023e8ffad705 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.487850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6396364-8ca0-4854-ade0-3de8ad09927f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.497254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2dd0-24d0-4d69-9ac2-725f40135eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.499269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2dd0-24d0-4d69-9ac2-725f40135eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.499653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2dd0-24d0-4d69-9ac2-725f40135eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.500029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2dd0-24d0-4d69-9ac2-725f40135eb6 admin admin] PATH_INFO: `/v3/projects/47fae0e126944392aac63d657646d5e0/users/09664e6ce77d4f7690beea16a17d388f/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.506301 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 800/1605] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:00.507098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace79f3a-4e44-4336-a544-023e8ffad705 service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.516914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2dd0-24d0-4d69-9ac2-725f40135eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47fae0e126944392aac63d657646d5e0, user_id=09664e6ce77d4f7690beea16a17d388f, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.518240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace79f3a-4e44-4336-a544-023e8ffad705 service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.522994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0341df-6a79-44fe-8225-76be974a6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.523890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0341df-6a79-44fe-8225-76be974a6e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.524178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0341df-6a79-44fe-8225-76be974a6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.524477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0341df-6a79-44fe-8225-76be974a6e45 admin admin] PATH_INFO: `/v3/projects/9b08e734c7b543e3a6c3150d8ba3dda2/users/f38293b202a4451bb577b28727d986fe/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.528288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2dd0-24d0-4d69-9ac2-725f40135eb6 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.541454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0341df-6a79-44fe-8225-76be974a6e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b08e734c7b543e3a6c3150d8ba3dda2, user_id=f38293b202a4451bb577b28727d986fe, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.544195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0341df-6a79-44fe-8225-76be974a6e45 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.586328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 806/1606] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:00 2022] PUT /identity/v3/projects/47fae0e126944392aac63d657646d5e0/users/09664e6ce77d4f7690beea16a17d388f/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:00.587697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2dd0-24d0-4d69-9ac2-725f40135eb6 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.608458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 801/1607] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:00 2022] PUT /identity/v3/projects/9b08e734c7b543e3a6c3150d8ba3dda2/users/f38293b202a4451bb577b28727d986fe/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:00.610985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ad7cf-6866-4382-9e7e-69f1fa68d4ba None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.611282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ad7cf-6866-4382-9e7e-69f1fa68d4ba None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.611565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ad7cf-6866-4382-9e7e-69f1fa68d4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.635000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6d9ad7cf-6866-4382-9e7e-69f1fa68d4ba None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:00.636332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6d9ad7cf-6866-4382-9e7e-69f1fa68d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:00.658159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2dd0-24d0-4d69-9ac2-725f40135eb6 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.680753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:00.742982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 802/1608] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:00.743998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ad7cf-6866-4382-9e7e-69f1fa68d4ba None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:00.761332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ad7cf-6866-4382-9e7e-69f1fa68d4ba None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:00.765032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87e0e3-2c27-4654-90e8-aaa9bd984c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.766319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87e0e3-2c27-4654-90e8-aaa9bd984c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.766544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02fa85-7b24-411d-b4c2-7148f8d6ebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:00.766814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87e0e3-2c27-4654-90e8-aaa9bd984c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.767201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87e0e3-2c27-4654-90e8-aaa9bd984c12 admin admin] PATH_INFO: `/v3/projects/e77fa6d0540c41b1ac418a5599e56e26/users/b21bf3717c1045088c5f45a88b6c3b15/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.767457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02fa85-7b24-411d-b4c2-7148f8d6ebd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.767753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02fa85-7b24-411d-b4c2-7148f8d6ebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.768034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02fa85-7b24-411d-b4c2-7148f8d6ebd4 admin admin] PATH_INFO: `/v3/projects/a021f19d3d0a4d9da017530731b9cc13/users/35d57d408e4f4a92b2f681c9fc1370eb/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.784905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87e0e3-2c27-4654-90e8-aaa9bd984c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77fa6d0540c41b1ac418a5599e56e26, user_id=b21bf3717c1045088c5f45a88b6c3b15, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.786793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02fa85-7b24-411d-b4c2-7148f8d6ebd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a021f19d3d0a4d9da017530731b9cc13, user_id=35d57d408e4f4a92b2f681c9fc1370eb, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:00.788748 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87e0e3-2c27-4654-90e8-aaa9bd984c12 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.789913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02fa85-7b24-411d-b4c2-7148f8d6ebd4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:00.888473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 807/1609] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:00 2022] PUT /identity/v3/projects/e77fa6d0540c41b1ac418a5599e56e26/users/b21bf3717c1045088c5f45a88b6c3b15/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:00.892063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f8356-7ea4-45c8-b5d5-43e3b4b96d49 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.892063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f8356-7ea4-45c8-b5d5-43e3b4b96d49 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.892063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f8356-7ea4-45c8-b5d5-43e3b4b96d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.928941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 803/1610] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:00 2022] PUT /identity/v3/projects/a021f19d3d0a4d9da017530731b9cc13/users/35d57d408e4f4a92b2f681c9fc1370eb/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:00.928941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74a06-6640-4d56-9360-42c55bcd023d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:00.928941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74a06-6640-4d56-9360-42c55bcd023d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:00.928941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74a06-6640-4d56-9360-42c55bcd023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:00.929434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-9e5f8356-7ea4-45c8-b5d5-43e3b4b96d49 None None] MFA Rules not processed for user `109d92580d6c4083baf480f944d51d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:00.929434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9e5f8356-7ea4-45c8-b5d5-43e3b4b96d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:00.947281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2ec74a06-6640-4d56-9360-42c55bcd023d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:00.948584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2ec74a06-6640-4d56-9360-42c55bcd023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:01.004114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 808/1611] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:01.005961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc99895-c187-4a58-a6d7-f22ff303d074 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.006262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc99895-c187-4a58-a6d7-f22ff303d074 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.006545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc99895-c187-4a58-a6d7-f22ff303d074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.015860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 804/1612] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:01.024445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed2d7-bf76-4ac7-a9ee-7ce19782b37c None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.024445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed2d7-bf76-4ac7-a9ee-7ce19782b37c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.024445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed2d7-bf76-4ac7-a9ee-7ce19782b37c None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.024445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 805/1613] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 30 10:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:51:01.024445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed2d7-bf76-4ac7-a9ee-7ce19782b37c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.032238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7bc99895-c187-4a58-a6d7-f22ff303d074 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:01.033445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7bc99895-c187-4a58-a6d7-f22ff303d074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:01.043521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 809/1614] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:01.044611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4504f1-a01b-42d6-9d87-13dcb592cc23 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.044905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4504f1-a01b-42d6-9d87-13dcb592cc23 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.045179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4504f1-a01b-42d6-9d87-13dcb592cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.057637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:01.067079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4f4504f1-a01b-42d6-9d87-13dcb592cc23 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:01.068941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4f4504f1-a01b-42d6-9d87-13dcb592cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:01.084444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 810/1615] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:01.084444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d066f-c49b-466d-8266-7fcedda5982f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.084444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d066f-c49b-466d-8266-7fcedda5982f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.084444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d066f-c49b-466d-8266-7fcedda5982f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.088738 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed2d7-bf76-4ac7-a9ee-7ce19782b37c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.092984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91bd9-f0ee-450d-8fb5-a8b1400f78f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.093751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91bd9-f0ee-450d-8fb5-a8b1400f78f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.093961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91bd9-f0ee-450d-8fb5-a8b1400f78f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.094255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91bd9-f0ee-450d-8fb5-a8b1400f78f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.104125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef91bd9-f0ee-450d-8fb5-a8b1400f78f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.105557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef91bd9-f0ee-450d-8fb5-a8b1400f78f8 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.112190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f36d066f-c49b-466d-8266-7fcedda5982f None None] MFA Rules not processed for user `35d57d408e4f4a92b2f681c9fc1370eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:01.114377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f36d066f-c49b-466d-8266-7fcedda5982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:01.115493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 806/1616] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:01.119266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91bd9-f0ee-450d-8fb5-a8b1400f78f8 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.129466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91bd9-f0ee-450d-8fb5-a8b1400f78f8 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.137128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c17ff-8996-4448-809e-b1c284a271d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.137926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c17ff-8996-4448-809e-b1c284a271d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.138299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c17ff-8996-4448-809e-b1c284a271d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.143155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c17ff-8996-4448-809e-b1c284a271d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.143155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c17ff-8996-4448-809e-b1c284a271d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.143155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c17ff-8996-4448-809e-b1c284a271d9 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.181545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 811/1617] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:01.182873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62b22-6579-4448-a930-e9a259e336a4 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.183168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62b22-6579-4448-a930-e9a259e336a4 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.183451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62b22-6579-4448-a930-e9a259e336a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.201862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-75e62b22-6579-4448-a930-e9a259e336a4 None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:01.203114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-75e62b22-6579-4448-a930-e9a259e336a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:01.209261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:01.254630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 807/1618] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:01 2022] POST /identity/v3/projects => generated 355 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:01.259428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c17ff-8996-4448-809e-b1c284a271d9 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.296797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 812/1619] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:01.297788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e62b22-6579-4448-a930-e9a259e336a4 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.307115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e62b22-6579-4448-a930-e9a259e336a4 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.321735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c17ff-8996-4448-809e-b1c284a271d9 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.326089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c261570-282d-4fde-9f2b-934f65bbdb7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.326747 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c261570-282d-4fde-9f2b-934f65bbdb7e service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.327036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c261570-282d-4fde-9f2b-934f65bbdb7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.327748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c261570-282d-4fde-9f2b-934f65bbdb7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.369078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23488429-3d58-42a6-b435-47ded0034b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.369848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23488429-3d58-42a6-b435-47ded0034b29 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.370175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23488429-3d58-42a6-b435-47ded0034b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.370463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23488429-3d58-42a6-b435-47ded0034b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.391049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c261570-282d-4fde-9f2b-934f65bbdb7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.392486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c261570-282d-4fde-9f2b-934f65bbdb7e service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.402400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 808/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:01.411149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c261570-282d-4fde-9f2b-934f65bbdb7e service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.429172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c261570-282d-4fde-9f2b-934f65bbdb7e service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.434910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70afd40-0bb7-4359-85d2-001ca42b07c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.436396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70afd40-0bb7-4359-85d2-001ca42b07c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.436983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70afd40-0bb7-4359-85d2-001ca42b07c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.437527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70afd40-0bb7-4359-85d2-001ca42b07c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.445630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23488429-3d58-42a6-b435-47ded0034b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.447225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23488429-3d58-42a6-b435-47ded0034b29 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.455879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70afd40-0bb7-4359-85d2-001ca42b07c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.455879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70afd40-0bb7-4359-85d2-001ca42b07c9 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.462631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 809/1621] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:01.463474 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70afd40-0bb7-4359-85d2-001ca42b07c9 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.473733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70afd40-0bb7-4359-85d2-001ca42b07c9 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.478679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 813/1622] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:01.479908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23488429-3d58-42a6-b435-47ded0034b29 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.481375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055d229-7bdf-42ba-95d5-a68534de8286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.482086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055d229-7bdf-42ba-95d5-a68534de8286 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.482932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055d229-7bdf-42ba-95d5-a68534de8286 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.483819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055d229-7bdf-42ba-95d5-a68534de8286 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.484540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055d229-7bdf-42ba-95d5-a68534de8286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.486685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055d229-7bdf-42ba-95d5-a68534de8286 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.498985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23488429-3d58-42a6-b435-47ded0034b29 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.517225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886513c-9960-48b0-9284-1707d7018cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.517970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886513c-9960-48b0-9284-1707d7018cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.518266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886513c-9960-48b0-9284-1707d7018cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.520986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886513c-9960-48b0-9284-1707d7018cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.520986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886513c-9960-48b0-9284-1707d7018cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.521260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886513c-9960-48b0-9284-1707d7018cd7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.610443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 810/1623] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:01 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:01.611313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055d229-7bdf-42ba-95d5-a68534de8286 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.627651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 814/1624] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:01 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:01.633598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886513c-9960-48b0-9284-1707d7018cd7 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.640850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886513c-9960-48b0-9284-1707d7018cd7 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.653774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:01.689919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:01.693002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055d229-7bdf-42ba-95d5-a68534de8286 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.697187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bbc19-fc29-43c1-981b-402aa09aa0e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.698178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bbc19-fc29-43c1-981b-402aa09aa0e3 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.698325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bbc19-fc29-43c1-981b-402aa09aa0e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.698568 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bbc19-fc29-43c1-981b-402aa09aa0e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.723805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9c69-8444-4162-8a16-a254a15d83a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.724796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9c69-8444-4162-8a16-a254a15d83a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.725253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9c69-8444-4162-8a16-a254a15d83a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.725704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9c69-8444-4162-8a16-a254a15d83a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.726752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b9c69-8444-4162-8a16-a254a15d83a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.729679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b9c69-8444-4162-8a16-a254a15d83a5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.781510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bbc19-fc29-43c1-981b-402aa09aa0e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.783731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bbc19-fc29-43c1-981b-402aa09aa0e3 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.800713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 811/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:01.801630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bbc19-fc29-43c1-981b-402aa09aa0e3 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.825006 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bbc19-fc29-43c1-981b-402aa09aa0e3 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.830447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268d3cf-1d83-4eee-b80a-b9e2e96280f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.831632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268d3cf-1d83-4eee-b80a-b9e2e96280f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.831632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268d3cf-1d83-4eee-b80a-b9e2e96280f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.832149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268d3cf-1d83-4eee-b80a-b9e2e96280f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.832893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268d3cf-1d83-4eee-b80a-b9e2e96280f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.835197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268d3cf-1d83-4eee-b80a-b9e2e96280f5 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.850479 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 815/1626] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:01 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:01.855248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 812/1627] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:01.855393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9c69-8444-4162-8a16-a254a15d83a5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.856381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268d3cf-1d83-4eee-b80a-b9e2e96280f5 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.867401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9c69-8444-4162-8a16-a254a15d83a5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.873907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbeef5-42c5-4c82-80cb-03e2644a2176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.874705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbeef5-42c5-4c82-80cb-03e2644a2176 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.874995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbeef5-42c5-4c82-80cb-03e2644a2176 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.875763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbeef5-42c5-4c82-80cb-03e2644a2176 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.876991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbeef5-42c5-4c82-80cb-03e2644a2176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.878626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268d3cf-1d83-4eee-b80a-b9e2e96280f5 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.884151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbeef5-42c5-4c82-80cb-03e2644a2176 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.884305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8bc0-b663-4609-8ff1-c90e1245c03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.884925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8bc0-b663-4609-8ff1-c90e1245c03d admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.885220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8bc0-b663-4609-8ff1-c90e1245c03d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.885507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8bc0-b663-4609-8ff1-c90e1245c03d admin admin] PATH_INFO: `/v3/projects/3bf7ee15c7374fdc88403bb29e2636db/users/a32f48dedce4448aa93c796c8aea7dba/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.901798 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 816/1628] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:51:01.906570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbeef5-42c5-4c82-80cb-03e2644a2176 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:01.919849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbeef5-42c5-4c82-80cb-03e2644a2176 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:01.925172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5616-3419-48a5-8fed-1633e54e188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:01.926400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5616-3419-48a5-8fed-1633e54e188f admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:01.927586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5616-3419-48a5-8fed-1633e54e188f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:01.927814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5616-3419-48a5-8fed-1633e54e188f admin admin] PATH_INFO: `/v3/projects/b37ba671de3d44adbc8635ff9c1b988d/users/be11764d1fbf4f09acb1a6085f3316b7/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:01.946108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a8bc0-b663-4609-8ff1-c90e1245c03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf7ee15c7374fdc88403bb29e2636db, user_id=a32f48dedce4448aa93c796c8aea7dba, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.949712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5616-3419-48a5-8fed-1633e54e188f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37ba671de3d44adbc8635ff9c1b988d, user_id=be11764d1fbf4f09acb1a6085f3316b7, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:01.952950 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a8bc0-b663-4609-8ff1-c90e1245c03d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:01.955144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5616-3419-48a5-8fed-1633e54e188f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:02.048982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 813/1629] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:01 2022] PUT /identity/v3/projects/3bf7ee15c7374fdc88403bb29e2636db/users/a32f48dedce4448aa93c796c8aea7dba/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:02.053273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 817/1630] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:01 2022] PUT /identity/v3/projects/b37ba671de3d44adbc8635ff9c1b988d/users/be11764d1fbf4f09acb1a6085f3316b7/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:02.055691 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8bc0-b663-4609-8ff1-c90e1245c03d admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:02.059184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5616-3419-48a5-8fed-1633e54e188f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:02.213489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5616-3419-48a5-8fed-1633e54e188f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:02.217226 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8bc0-b663-4609-8ff1-c90e1245c03d admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:02.222023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710390a0-9f5c-4e84-9fba-71e845e0414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:02.222023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710390a0-9f5c-4e84-9fba-71e845e0414b admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:02.222023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710390a0-9f5c-4e84-9fba-71e845e0414b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:02.222023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710390a0-9f5c-4e84-9fba-71e845e0414b admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:02.222558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710390a0-9f5c-4e84-9fba-71e845e0414b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:02.224495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710390a0-9f5c-4e84-9fba-71e845e0414b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:02.233910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fdbd5-2004-4b69-a2e7-55e692f92b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:02.235987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fdbd5-2004-4b69-a2e7-55e692f92b1b admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:02.236435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fdbd5-2004-4b69-a2e7-55e692f92b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:02.236920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fdbd5-2004-4b69-a2e7-55e692f92b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:02.238223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fdbd5-2004-4b69-a2e7-55e692f92b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:02.239583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 818/1631] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:02.240982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710390a0-9f5c-4e84-9fba-71e845e0414b admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:02.242410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fdbd5-2004-4b69-a2e7-55e692f92b1b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:02.253687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710390a0-9f5c-4e84-9fba-71e845e0414b admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:02.259272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279f4d9-f1bd-4c48-9b3b-202a5cdd1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:02.260828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279f4d9-f1bd-4c48-9b3b-202a5cdd1da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:02.261073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279f4d9-f1bd-4c48-9b3b-202a5cdd1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:02.261428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279f4d9-f1bd-4c48-9b3b-202a5cdd1da4 admin admin] PATH_INFO: `/v3/projects/3bf7ee15c7374fdc88403bb29e2636db/users/a32f48dedce4448aa93c796c8aea7dba/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:02.263456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279f4d9-f1bd-4c48-9b3b-202a5cdd1da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf7ee15c7374fdc88403bb29e2636db, user_id=a32f48dedce4448aa93c796c8aea7dba, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:02.271065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 814/1632] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:02.271184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279f4d9-f1bd-4c48-9b3b-202a5cdd1da4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:02.272288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fdbd5-2004-4b69-a2e7-55e692f92b1b admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:02.287393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 819/1633] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:02 2022] PUT /identity/v3/projects/3bf7ee15c7374fdc88403bb29e2636db/users/a32f48dedce4448aa93c796c8aea7dba/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:02.292245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b581a-55f8-47f4-8ffd-d7bc7a0c0469 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:02.292970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b581a-55f8-47f4-8ffd-d7bc7a0c0469 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:02.293271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b581a-55f8-47f4-8ffd-d7bc7a0c0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:02.293933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fdbd5-2004-4b69-a2e7-55e692f92b1b admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:02.318441 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:02.351436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-093b581a-55f8-47f4-8ffd-d7bc7a0c0469 None None] MFA Rules not processed for user `a32f48dedce4448aa93c796c8aea7dba`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:02.354278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-093b581a-55f8-47f4-8ffd-d7bc7a0c0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:02.393067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a66a-d42a-48b9-ab02-35f69e4eab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:02.394520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a66a-d42a-48b9-ab02-35f69e4eab68 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:02.394965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a66a-d42a-48b9-ab02-35f69e4eab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:02.395953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a66a-d42a-48b9-ab02-35f69e4eab68 admin admin] PATH_INFO: `/v3/projects/b37ba671de3d44adbc8635ff9c1b988d/users/be11764d1fbf4f09acb1a6085f3316b7/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:02.398331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a66a-d42a-48b9-ab02-35f69e4eab68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37ba671de3d44adbc8635ff9c1b988d, user_id=be11764d1fbf4f09acb1a6085f3316b7, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:02.401504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a66a-d42a-48b9-ab02-35f69e4eab68 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:02.430048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 815/1634] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:02 2022] PUT /identity/v3/projects/b37ba671de3d44adbc8635ff9c1b988d/users/be11764d1fbf4f09acb1a6085f3316b7/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:02.435371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5b4ae-4bb2-4943-a84a-b54ced7661c9 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:02.435371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5b4ae-4bb2-4943-a84a-b54ced7661c9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:02.435371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5b4ae-4bb2-4943-a84a-b54ced7661c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:02.474608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:02.483276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 820/1635] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:02.498073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b581a-55f8-47f4-8ffd-d7bc7a0c0469 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:02.501746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4bf5b4ae-4bb2-4943-a84a-b54ced7661c9 None None] MFA Rules not processed for user `be11764d1fbf4f09acb1a6085f3316b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:02.503345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4bf5b4ae-4bb2-4943-a84a-b54ced7661c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:02.622612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b581a-55f8-47f4-8ffd-d7bc7a0c0469 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:02.634944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 816/1636] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:02.730470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581815e-9023-444c-b3d4-3e48c21b036a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:02.731584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581815e-9023-444c-b3d4-3e48c21b036a service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:02.732032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581815e-9023-444c-b3d4-3e48c21b036a service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:02.732315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581815e-9023-444c-b3d4-3e48c21b036a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:02.812864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581815e-9023-444c-b3d4-3e48c21b036a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:02.814674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581815e-9023-444c-b3d4-3e48c21b036a service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:02.825842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 821/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:02 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:03.042046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5b4ae-4bb2-4943-a84a-b54ced7661c9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:03.062649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5b4ae-4bb2-4943-a84a-b54ced7661c9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:03.077659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aae4b-01ad-4b07-a265-55cea7bd57d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:03.078369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aae4b-01ad-4b07-a265-55cea7bd57d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:03.078858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aae4b-01ad-4b07-a265-55cea7bd57d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:03.079318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aae4b-01ad-4b07-a265-55cea7bd57d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:03.104660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aae4b-01ad-4b07-a265-55cea7bd57d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:03.106153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aae4b-01ad-4b07-a265-55cea7bd57d3 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:03.124027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 817/1638] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:03.312553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581815e-9023-444c-b3d4-3e48c21b036a service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:03.325673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581815e-9023-444c-b3d4-3e48c21b036a service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:03.344315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d157a6b-2d69-4f06-af73-b995da414627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:03.345582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d157a6b-2d69-4f06-af73-b995da414627 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:03.346091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d157a6b-2d69-4f06-af73-b995da414627 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:03.346661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d157a6b-2d69-4f06-af73-b995da414627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:03.522165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d157a6b-2d69-4f06-af73-b995da414627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:03.523611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d157a6b-2d69-4f06-af73-b995da414627 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:03.547459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 822/1639] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:03 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:03.631900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aae4b-01ad-4b07-a265-55cea7bd57d3 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:03.644131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aae4b-01ad-4b07-a265-55cea7bd57d3 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:03.652486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea48240-2731-4eb5-8123-0cb189c9666b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:03.653331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea48240-2731-4eb5-8123-0cb189c9666b service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:03.654759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea48240-2731-4eb5-8123-0cb189c9666b service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:03.655178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea48240-2731-4eb5-8123-0cb189c9666b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:03.783633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717206b7-d655-4ed2-89bb-bea44f006d6c None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:03.784111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717206b7-d655-4ed2-89bb-bea44f006d6c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:03.784408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717206b7-d655-4ed2-89bb-bea44f006d6c None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:03.785115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea48240-2731-4eb5-8123-0cb189c9666b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:03.787196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 823/1640] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jun 30 10:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:51:03.791341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea48240-2731-4eb5-8123-0cb189c9666b service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:03.806958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 818/1641] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:03.826644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b9e87-424a-4293-a215-c9ddee139c43 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:03.827094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b9e87-424a-4293-a215-c9ddee139c43 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:03.827511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b9e87-424a-4293-a215-c9ddee139c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:03.836676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:03.860463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-2d0b9e87-424a-4293-a215-c9ddee139c43 None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:03.863414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2d0b9e87-424a-4293-a215-c9ddee139c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:04.055304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 824/1642] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jun 30 10:51:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:04.061677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acedc34-3bca-482a-a21f-2e40c5cc6ead None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:04.062415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acedc34-3bca-482a-a21f-2e40c5cc6ead None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:04.063401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acedc34-3bca-482a-a21f-2e40c5cc6ead None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:04.065182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 819/1643] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 30 10:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:51:04.073405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7abf-8375-43d2-bde2-2b531e0c4d2b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:04.076365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7abf-8375-43d2-bde2-2b531e0c4d2b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:04.076365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7abf-8375-43d2-bde2-2b531e0c4d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:04.116255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f04d7abf-8375-43d2-bde2-2b531e0c4d2b None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:04.117588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f04d7abf-8375-43d2-bde2-2b531e0c4d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:04.128598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 825/1644] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:04.271713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acedc34-3bca-482a-a21f-2e40c5cc6ead None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:04.292146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acedc34-3bca-482a-a21f-2e40c5cc6ead None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:04.301488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c740bc2-643b-4676-978d-4141f8bf2e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:04.303248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740bc2-643b-4676-978d-4141f8bf2e3e service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:04.303756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740bc2-643b-4676-978d-4141f8bf2e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:04.304283 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740bc2-643b-4676-978d-4141f8bf2e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:04.319504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c740bc2-643b-4676-978d-4141f8bf2e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:04.333136 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c740bc2-643b-4676-978d-4141f8bf2e3e service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:04.348348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 820/1645] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:06.306598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7abf-8375-43d2-bde2-2b531e0c4d2b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:06.445824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7abf-8375-43d2-bde2-2b531e0c4d2b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:06.473288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:06.476554 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:06.477244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:06.477738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] PATH_INFO: `/v3/users/3f25b12a55804b1b904ab4d3afbc96a9` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:06.481678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f25b12a55804b1b904ab4d3afbc96a9)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:06.484194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:06.768725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f25b12a55804b1b904ab4d3afbc96a9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:06.893534 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f25b12a55804b1b904ab4d3afbc96a9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:06.919363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f25b12a55804b1b904ab4d3afbc96a9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:06.921098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f25b12a55804b1b904ab4d3afbc96a9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:06.937447 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f25b12a55804b1b904ab4d3afbc96a9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:06.960920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 826/1646] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:06 2022] DELETE /identity/v3/users/3f25b12a55804b1b904ab4d3afbc96a9 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:06.965526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702590-7d5f-406c-83f5-17a3bbe348c4 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:06.966413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702590-7d5f-406c-83f5-17a3bbe348c4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:06.968755 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702590-7d5f-406c-83f5-17a3bbe348c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:06.992802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-90702590-7d5f-406c-83f5-17a3bbe348c4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:06.995627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-90702590-7d5f-406c-83f5-17a3bbe348c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:07.020013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:07.097233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 821/1647] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:07.175160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:07.176689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:07.216923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:07.337125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357a392-be84-4ac4-b30d-5f6d75666aaf admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:07.356660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6b594-f584-4b99-878b-e16defd5e4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:07.358382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b594-f584-4b99-878b-e16defd5e4eb service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:07.368655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b594-f584-4b99-878b-e16defd5e4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:07.368655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b594-f584-4b99-878b-e16defd5e4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:07.404431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6b594-f584-4b99-878b-e16defd5e4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:07.408788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6b594-f584-4b99-878b-e16defd5e4eb service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:07.448071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 827/1648] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:09.844717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90702590-7d5f-406c-83f5-17a3bbe348c4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:09.847405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-90702590-7d5f-406c-83f5-17a3bbe348c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:09.912435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90702590-7d5f-406c-83f5-17a3bbe348c4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:09.925783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:09.928039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:09.928457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:09.928881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] PATH_INFO: `/v3/projects/b5590986de0c4c1280ad211b617c813e` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:09.941867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5590986de0c4c1280ad211b617c813e)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:09.952742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:10.252988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5590986de0c4c1280ad211b617c813e', 'request_id': 'req-80216ff0-b4fa-48fb-a032-14f11326b5bb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:10.267044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5590986de0c4c1280ad211b617c813e', 'request_id': 'req-80216ff0-b4fa-48fb-a032-14f11326b5bb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:10.397986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5590986de0c4c1280ad211b617c813e', 'request_id': 'req-80216ff0-b4fa-48fb-a032-14f11326b5bb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:10.418163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] The token cache is being invalidate because project b5590986de0c4c1280ad211b617c813e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:10.418550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:10.419658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-80216ff0-b4fa-48fb-a032-14f11326b5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:10.423783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 822/1649] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:09 2022] DELETE /identity/v3/projects/b5590986de0c4c1280ad211b617c813e => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:10.429973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2654dbc-5624-45f1-bb91-57cbcde4da27 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:10.430927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2654dbc-5624-45f1-bb91-57cbcde4da27 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:10.431714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2654dbc-5624-45f1-bb91-57cbcde4da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:10.468302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b2654dbc-5624-45f1-bb91-57cbcde4da27 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:10.474102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b2654dbc-5624-45f1-bb91-57cbcde4da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:10.637510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 828/1650] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:10.645379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad98c-85d7-4acc-9af1-ecf7737956ec None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:10.647442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad98c-85d7-4acc-9af1-ecf7737956ec None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:10.647964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad98c-85d7-4acc-9af1-ecf7737956ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:10.687366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b15ad98c-85d7-4acc-9af1-ecf7737956ec None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:10.689297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b15ad98c-85d7-4acc-9af1-ecf7737956ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:10.713631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 823/1651] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:10.716046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2654dbc-5624-45f1-bb91-57cbcde4da27 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:10.734110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2654dbc-5624-45f1-bb91-57cbcde4da27 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:10.746556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e6de1-3d7c-4885-9722-b6ea0b9e5d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:10.747662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e6de1-3d7c-4885-9722-b6ea0b9e5d05 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:10.748689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e6de1-3d7c-4885-9722-b6ea0b9e5d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:10.749977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e6de1-3d7c-4885-9722-b6ea0b9e5d05 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:10.752540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e6de1-3d7c-4885-9722-b6ea0b9e5d05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:10.753016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e6de1-3d7c-4885-9722-b6ea0b9e5d05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:10.760197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e6de1-3d7c-4885-9722-b6ea0b9e5d05 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:10.797881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 829/1652] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:10.799184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ad98c-85d7-4acc-9af1-ecf7737956ec None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:10.814405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ad98c-85d7-4acc-9af1-ecf7737956ec None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:10.824348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c12e2-34a0-4b1f-a786-ae82b3dd6d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:10.826540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c12e2-34a0-4b1f-a786-ae82b3dd6d99 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:10.826928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c12e2-34a0-4b1f-a786-ae82b3dd6d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:10.828808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c12e2-34a0-4b1f-a786-ae82b3dd6d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:10.830033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c12e2-34a0-4b1f-a786-ae82b3dd6d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:10.832160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c12e2-34a0-4b1f-a786-ae82b3dd6d99 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:10.965335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 824/1653] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:10 2022] POST /identity/v3/projects => generated 403 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:10.969896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e6de1-3d7c-4885-9722-b6ea0b9e5d05 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:10.986170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e6de1-3d7c-4885-9722-b6ea0b9e5d05 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:11.147905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0121ff3-d952-4eff-b98e-77776fcc18dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:11.150083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0121ff3-d952-4eff-b98e-77776fcc18dc admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:11.152236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0121ff3-d952-4eff-b98e-77776fcc18dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:11.152236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0121ff3-d952-4eff-b98e-77776fcc18dc admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:11.152529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0121ff3-d952-4eff-b98e-77776fcc18dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:11.163769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0121ff3-d952-4eff-b98e-77776fcc18dc admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:11.309575 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 830/1654] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:10 2022] POST /identity/v3/users => generated 302 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:11.313505 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c12e2-34a0-4b1f-a786-ae82b3dd6d99 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:11.346455 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c12e2-34a0-4b1f-a786-ae82b3dd6d99 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:11.360809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38783f70-8b4b-454e-96cc-4cc80d47f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:11.362152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783f70-8b4b-454e-96cc-4cc80d47f554 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:11.371127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783f70-8b4b-454e-96cc-4cc80d47f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:11.371127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783f70-8b4b-454e-96cc-4cc80d47f554 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:11.371127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38783f70-8b4b-454e-96cc-4cc80d47f554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:11.371127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38783f70-8b4b-454e-96cc-4cc80d47f554 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:11.414502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 825/1655] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:11.416066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0121ff3-d952-4eff-b98e-77776fcc18dc admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:11.430744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0121ff3-d952-4eff-b98e-77776fcc18dc admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:11.447211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f50f2-24a4-4e48-893b-64a4c420d817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:11.447894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f50f2-24a4-4e48-893b-64a4c420d817 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:11.448191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f50f2-24a4-4e48-893b-64a4c420d817 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:11.448476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f50f2-24a4-4e48-893b-64a4c420d817 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:11.449234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f50f2-24a4-4e48-893b-64a4c420d817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:11.450937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f50f2-24a4-4e48-893b-64a4c420d817 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:11.475956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 831/1656] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:11.483907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38783f70-8b4b-454e-96cc-4cc80d47f554 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:11.495744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38783f70-8b4b-454e-96cc-4cc80d47f554 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:11.513482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cd3be-a82b-45d6-b9e1-2ea5311de712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:11.514899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cd3be-a82b-45d6-b9e1-2ea5311de712 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:11.516868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cd3be-a82b-45d6-b9e1-2ea5311de712 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:11.524313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cd3be-a82b-45d6-b9e1-2ea5311de712 admin admin] PATH_INFO: `/v3/projects/09def80feaee4c3d8c9b07b5b56f9973/users/e2a8334d262743fba4eaff668a0e2660/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:11.545256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cd3be-a82b-45d6-b9e1-2ea5311de712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09def80feaee4c3d8c9b07b5b56f9973, user_id=e2a8334d262743fba4eaff668a0e2660, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:11.548746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cd3be-a82b-45d6-b9e1-2ea5311de712 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:11.659001 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 826/1657] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:11 2022] PUT /identity/v3/projects/09def80feaee4c3d8c9b07b5b56f9973/users/e2a8334d262743fba4eaff668a0e2660/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:11.662427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1ffef-0042-4e84-ae86-fe04f911bff3 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:11.662732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1ffef-0042-4e84-ae86-fe04f911bff3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:11.663045 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1ffef-0042-4e84-ae86-fe04f911bff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:11.763035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-5cd1ffef-0042-4e84-ae86-fe04f911bff3 None None] MFA Rules not processed for user `e2a8334d262743fba4eaff668a0e2660`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:11.765095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5cd1ffef-0042-4e84-ae86-fe04f911bff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:11.770680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:11.965952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 832/1658] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:11.970550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cd3be-a82b-45d6-b9e1-2ea5311de712 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:12.093871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:12.184476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cd3be-a82b-45d6-b9e1-2ea5311de712 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:12.195004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade14f6c-57d2-4a54-8d80-a19fd50a4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:12.196239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14f6c-57d2-4a54-8d80-a19fd50a4833 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:12.196690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14f6c-57d2-4a54-8d80-a19fd50a4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:12.197165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14f6c-57d2-4a54-8d80-a19fd50a4833 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:12.200493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade14f6c-57d2-4a54-8d80-a19fd50a4833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:12.205961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade14f6c-57d2-4a54-8d80-a19fd50a4833 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:12.339117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 827/1659] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:11 2022] POST /identity/v3/projects => generated 403 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:12.343027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1ffef-0042-4e84-ae86-fe04f911bff3 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:12.361449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1ffef-0042-4e84-ae86-fe04f911bff3 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:12.485478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f6aef-57b1-491a-b807-b0c38ee000d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:12.486486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f6aef-57b1-491a-b807-b0c38ee000d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:12.486947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f6aef-57b1-491a-b807-b0c38ee000d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:12.487292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f6aef-57b1-491a-b807-b0c38ee000d7 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:12.488208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f6aef-57b1-491a-b807-b0c38ee000d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:12.490618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f6aef-57b1-491a-b807-b0c38ee000d7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:12.535228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64b36d-58fa-496a-acc6-a58280ba5077 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:12.535579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64b36d-58fa-496a-acc6-a58280ba5077 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:12.536029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64b36d-58fa-496a-acc6-a58280ba5077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:12.609828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9d64b36d-58fa-496a-acc6-a58280ba5077 None None] MFA Rules not processed for user `52599ae5d7a045e6b6156352322e5642`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:12.613255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9d64b36d-58fa-496a-acc6-a58280ba5077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:12.628927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 833/1660] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:12 2022] POST /identity/v3/users => generated 308 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:12.634580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f6aef-57b1-491a-b807-b0c38ee000d7 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:12.661165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f6aef-57b1-491a-b807-b0c38ee000d7 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:12.679023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408b70-06f8-4fc2-99c1-ead7fb81d604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:12.682367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408b70-06f8-4fc2-99c1-ead7fb81d604 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:12.685459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408b70-06f8-4fc2-99c1-ead7fb81d604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:12.687298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408b70-06f8-4fc2-99c1-ead7fb81d604 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:12.689665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3408b70-06f8-4fc2-99c1-ead7fb81d604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:12.711910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3408b70-06f8-4fc2-99c1-ead7fb81d604 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:12.759485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 834/1661] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:12.761819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 828/1662] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:12.775359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408b70-06f8-4fc2-99c1-ead7fb81d604 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:12.776489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64b36d-58fa-496a-acc6-a58280ba5077 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:12.778569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9d64b36d-58fa-496a-acc6-a58280ba5077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:12.789301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408b70-06f8-4fc2-99c1-ead7fb81d604 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:12.803420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a59e77-0435-4ed3-8be4-ef4157ed6a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:12.804586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a59e77-0435-4ed3-8be4-ef4157ed6a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:12.805020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a59e77-0435-4ed3-8be4-ef4157ed6a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:12.806939 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a59e77-0435-4ed3-8be4-ef4157ed6a81 admin admin] PATH_INFO: `/v3/projects/ce706fae96b04f08b99de9001fc262a0/users/e96b4fbda52a436080c9e95c39415e74/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:12.850555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a59e77-0435-4ed3-8be4-ef4157ed6a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce706fae96b04f08b99de9001fc262a0, user_id=e96b4fbda52a436080c9e95c39415e74, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:12.856568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a59e77-0435-4ed3-8be4-ef4157ed6a81 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:12.950289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64b36d-58fa-496a-acc6-a58280ba5077 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:12.963682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e703197-83ae-4b95-8333-5402ff7e6c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:12.964293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e703197-83ae-4b95-8333-5402ff7e6c41 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:12.964585 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e703197-83ae-4b95-8333-5402ff7e6c41 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:12.965139 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e703197-83ae-4b95-8333-5402ff7e6c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:12.983388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e703197-83ae-4b95-8333-5402ff7e6c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:12.985048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e703197-83ae-4b95-8333-5402ff7e6c41 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:12.991461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 835/1663] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:12 2022] PUT /identity/v3/projects/ce706fae96b04f08b99de9001fc262a0/users/e96b4fbda52a436080c9e95c39415e74/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:12.996275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a59e77-0435-4ed3-8be4-ef4157ed6a81 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:13.020110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 829/1664] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:13.182469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a59e77-0435-4ed3-8be4-ef4157ed6a81 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:13.187671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba40300-7834-40b5-b791-e2682951da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:13.188374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba40300-7834-40b5-b791-e2682951da67 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:13.188667 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba40300-7834-40b5-b791-e2682951da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:13.204519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba40300-7834-40b5-b791-e2682951da67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:13.205425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba40300-7834-40b5-b791-e2682951da67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:13.207192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba40300-7834-40b5-b791-e2682951da67 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:13.215625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:13.243020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 836/1665] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:13.244201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e703197-83ae-4b95-8333-5402ff7e6c41 service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:13.261544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e703197-83ae-4b95-8333-5402ff7e6c41 service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:13.275356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243b19-09c0-429f-9817-96ae0f317da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:13.276550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243b19-09c0-429f-9817-96ae0f317da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:13.276884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243b19-09c0-429f-9817-96ae0f317da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:13.277170 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243b19-09c0-429f-9817-96ae0f317da8 admin admin] PATH_INFO: `/v3/projects/ce706fae96b04f08b99de9001fc262a0/users/e96b4fbda52a436080c9e95c39415e74/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:13.282306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7243b19-09c0-429f-9817-96ae0f317da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce706fae96b04f08b99de9001fc262a0, user_id=e96b4fbda52a436080c9e95c39415e74, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:13.288072 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7243b19-09c0-429f-9817-96ae0f317da8 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:13.320391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 830/1666] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:13 2022] PUT /identity/v3/projects/ce706fae96b04f08b99de9001fc262a0/users/e96b4fbda52a436080c9e95c39415e74/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:13.334511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d72d6c-48e1-4be2-8837-0e7051ebcce8 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:13.335018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d72d6c-48e1-4be2-8837-0e7051ebcce8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:13.335504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d72d6c-48e1-4be2-8837-0e7051ebcce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:13.394711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-24d72d6c-48e1-4be2-8837-0e7051ebcce8 None None] MFA Rules not processed for user `e96b4fbda52a436080c9e95c39415e74`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:13.396710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-24d72d6c-48e1-4be2-8837-0e7051ebcce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:13.542458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 837/1667] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:13.555320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243b19-09c0-429f-9817-96ae0f317da8 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:13.557507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f7243b19-09c0-429f-9817-96ae0f317da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:13.651952 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243b19-09c0-429f-9817-96ae0f317da8 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:13.657710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa37b6-9359-48a8-823d-44fa040aaab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:13.658260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa37b6-9359-48a8-823d-44fa040aaab9 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:13.658523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa37b6-9359-48a8-823d-44fa040aaab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:13.658803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa37b6-9359-48a8-823d-44fa040aaab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:13.672463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa37b6-9359-48a8-823d-44fa040aaab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:13.674177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa37b6-9359-48a8-823d-44fa040aaab9 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:13.686811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 831/1668] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:14.164876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d72d6c-48e1-4be2-8837-0e7051ebcce8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:14.323298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d72d6c-48e1-4be2-8837-0e7051ebcce8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:14.328853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:14.329883 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:14.336535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:14.336535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] PATH_INFO: `/v3/users/e2a8334d262743fba4eaff668a0e2660` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:14.336535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a8334d262743fba4eaff668a0e2660)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:14.336535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:14.602469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a8334d262743fba4eaff668a0e2660'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:14.681861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a8334d262743fba4eaff668a0e2660'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:14.716235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a8334d262743fba4eaff668a0e2660'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:14.725211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a8334d262743fba4eaff668a0e2660'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:14.751263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a8334d262743fba4eaff668a0e2660'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:14.758082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 838/1669] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:14 2022] DELETE /identity/v3/users/e2a8334d262743fba4eaff668a0e2660 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:14.760723 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a44b3-ccf9-4bdd-a2b2-bd09f626514a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:14.761534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a44b3-ccf9-4bdd-a2b2-bd09f626514a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:14.762004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a44b3-ccf9-4bdd-a2b2-bd09f626514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:14.812080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b81a44b3-ccf9-4bdd-a2b2-bd09f626514a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:14.813514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b81a44b3-ccf9-4bdd-a2b2-bd09f626514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:14.974989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 832/1670] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:14.997413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:15.058893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:15.060470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:15.269801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09db12a-b5ab-4bea-84c0-e5ede0dc5117 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:15.275472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d0681-2e7d-4703-8b7b-e760f6e1a5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:15.281105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d0681-2e7d-4703-8b7b-e760f6e1a5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:15.281105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d0681-2e7d-4703-8b7b-e760f6e1a5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:15.281105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d0681-2e7d-4703-8b7b-e760f6e1a5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:15.308098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbfb87-3076-47cb-bf3b-d45fcc5ed7f2 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:15.308304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbfb87-3076-47cb-bf3b-d45fcc5ed7f2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:15.308596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbfb87-3076-47cb-bf3b-d45fcc5ed7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:15.358506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d0681-2e7d-4703-8b7b-e760f6e1a5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:15.361564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d0681-2e7d-4703-8b7b-e760f6e1a5f5 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:15.423286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 839/1671] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:15.451616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2cdbfb87-3076-47cb-bf3b-d45fcc5ed7f2 None None] MFA Rules not processed for user `f38293b202a4451bb577b28727d986fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:15.453481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2cdbfb87-3076-47cb-bf3b-d45fcc5ed7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:15.499889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:15.568890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 833/1672] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:15.587737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92e49a-c385-479a-bd3a-7d052962d847 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:15.587737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92e49a-c385-479a-bd3a-7d052962d847 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:15.587737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92e49a-c385-479a-bd3a-7d052962d847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:15.613588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-bb92e49a-c385-479a-bd3a-7d052962d847 None None] MFA Rules not processed for user `f38293b202a4451bb577b28727d986fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:15.616351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bb92e49a-c385-479a-bd3a-7d052962d847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:15.627067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 840/1673] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:15.642786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbfb87-3076-47cb-bf3b-d45fcc5ed7f2 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:15.648001 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2cdbfb87-3076-47cb-bf3b-d45fcc5ed7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:15.671257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92e49a-c385-479a-bd3a-7d052962d847 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:15.673817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bb92e49a-c385-479a-bd3a-7d052962d847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:15.704468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92e49a-c385-479a-bd3a-7d052962d847 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:15.720258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:15.721030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:15.721318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:15.721619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] PATH_INFO: `/v3/users/35d57d408e4f4a92b2f681c9fc1370eb` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:15.723578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d57d408e4f4a92b2f681c9fc1370eb)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:15.725897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:15.775417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbfb87-3076-47cb-bf3b-d45fcc5ed7f2 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:15.783738 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76c9d5-5b32-43db-bdf6-53934b1f48fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:15.784119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c9d5-5b32-43db-bdf6-53934b1f48fa service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:15.784415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c9d5-5b32-43db-bdf6-53934b1f48fa service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:15.784700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c9d5-5b32-43db-bdf6-53934b1f48fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:15.799413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76c9d5-5b32-43db-bdf6-53934b1f48fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:15.801349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76c9d5-5b32-43db-bdf6-53934b1f48fa service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:15.811909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 834/1674] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:15.983923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d57d408e4f4a92b2f681c9fc1370eb'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.106102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d57d408e4f4a92b2f681c9fc1370eb'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.157800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d57d408e4f4a92b2f681c9fc1370eb'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.159441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d57d408e4f4a92b2f681c9fc1370eb'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.175212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d57d408e4f4a92b2f681c9fc1370eb'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.190919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 841/1675] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:15 2022] DELETE /identity/v3/users/35d57d408e4f4a92b2f681c9fc1370eb => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:16.195819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5040-5489-4089-8d12-6cf74458198a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:16.196573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5040-5489-4089-8d12-6cf74458198a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:16.196573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5040-5489-4089-8d12-6cf74458198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:16.232363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2b4a5040-5489-4089-8d12-6cf74458198a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:16.234562 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2b4a5040-5489-4089-8d12-6cf74458198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:16.266160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:16.278796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:16.350750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 835/1676] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:16.408103 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0a51-1e8f-4c53-9e8b-b6bd9f783c88 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:16.415786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:16.416886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:16.417174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:16.417547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] PATH_INFO: `/v3/projects/09def80feaee4c3d8c9b07b5b56f9973` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:16.419241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09def80feaee4c3d8c9b07b5b56f9973)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:16.420454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: WARNING py.warnings [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:51:16.420454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: warnings.warn(msg) Jun 30 10:51:16.420454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: Jun 30 10:51:16.421828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:16.478323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a5040-5489-4089-8d12-6cf74458198a None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:16.480371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2b4a5040-5489-4089-8d12-6cf74458198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:16.623259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09def80feaee4c3d8c9b07b5b56f9973', 'request_id': 'req-547c0b90-8fde-4303-8004-29c64d149d51'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.635294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a5040-5489-4089-8d12-6cf74458198a None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:16.716940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09def80feaee4c3d8c9b07b5b56f9973', 'request_id': 'req-547c0b90-8fde-4303-8004-29c64d149d51'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.731153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:16.731153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef9a7-6f78-42a1-b8de-b7581b91fbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:16.731458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef9a7-6f78-42a1-b8de-b7581b91fbdf service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:16.733466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef9a7-6f78-42a1-b8de-b7581b91fbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:16.734328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef9a7-6f78-42a1-b8de-b7581b91fbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:16.760756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09def80feaee4c3d8c9b07b5b56f9973', 'request_id': 'req-547c0b90-8fde-4303-8004-29c64d149d51'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.780649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] The token cache is being invalidate because project 09def80feaee4c3d8c9b07b5b56f9973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:16.781101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.782458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:16.785126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 842/1677] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:16 2022] DELETE /identity/v3/projects/09def80feaee4c3d8c9b07b5b56f9973 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:16.790314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:16.798647 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:16.873426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0b90-8fde-4303-8004-29c64d149d51 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:16.895638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:16.896605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:16.896894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:16.897183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] PATH_INFO: `/v3/users/e96b4fbda52a436080c9e95c39415e74` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:16.898748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ef9a7-6f78-42a1-b8de-b7581b91fbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:16.900352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ef9a7-6f78-42a1-b8de-b7581b91fbdf service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:16.906778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96b4fbda52a436080c9e95c39415e74)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:16.908779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:16.937287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 836/1678] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:17.195118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96b4fbda52a436080c9e95c39415e74'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:17.338924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96b4fbda52a436080c9e95c39415e74'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:17.356012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96b4fbda52a436080c9e95c39415e74'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:17.357467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96b4fbda52a436080c9e95c39415e74'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:17.366913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-26afc129-f4f9-43ab-9b8f-fa7487e33f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96b4fbda52a436080c9e95c39415e74'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:17.378126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 843/1679] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:16 2022] DELETE /identity/v3/users/e96b4fbda52a436080c9e95c39415e74 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:17.418015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:17.682121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:17.772367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cf4ad-6cd5-408f-a470-b018f7e33289 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:17.772977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cf4ad-6cd5-408f-a470-b018f7e33289 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:17.773574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cf4ad-6cd5-408f-a470-b018f7e33289 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:17.775247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 837/1680] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 30 10:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:51:17.781658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f48fee-7f19-4f5f-80b6-6d60657c1f71 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:17.782336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f48fee-7f19-4f5f-80b6-6d60657c1f71 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:17.782803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f48fee-7f19-4f5f-80b6-6d60657c1f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:17.880408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-10f48fee-7f19-4f5f-80b6-6d60657c1f71 None None] MFA Rules not processed for user `719afb6dcb154119beb18d2f1974fe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:17.883360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-10f48fee-7f19-4f5f-80b6-6d60657c1f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:18.016588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 844/1681] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:51:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:18.266238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cf4ad-6cd5-408f-a470-b018f7e33289 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:18.269164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-911cf4ad-6cd5-408f-a470-b018f7e33289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:18.294628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cf4ad-6cd5-408f-a470-b018f7e33289 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:18.314268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbb570-5a51-4e3c-9f17-47e3ae9acf76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:18.314954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbb570-5a51-4e3c-9f17-47e3ae9acf76 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:18.315244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbb570-5a51-4e3c-9f17-47e3ae9acf76 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:18.315522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbb570-5a51-4e3c-9f17-47e3ae9acf76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:18.335623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbb570-5a51-4e3c-9f17-47e3ae9acf76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:18.337378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbb570-5a51-4e3c-9f17-47e3ae9acf76 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:18.384502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 838/1682] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:18.665465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f48fee-7f19-4f5f-80b6-6d60657c1f71 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:18.667102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-10f48fee-7f19-4f5f-80b6-6d60657c1f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:18.856224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f48fee-7f19-4f5f-80b6-6d60657c1f71 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:18.870830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:18.874032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:18.874924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:18.875360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] PATH_INFO: `/v3/projects/ce706fae96b04f08b99de9001fc262a0` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:18.880543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce706fae96b04f08b99de9001fc262a0)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:18.886156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:19.069181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce706fae96b04f08b99de9001fc262a0', 'request_id': 'req-22c92b86-c051-4b61-8031-97e6ef81aef5'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:19.155308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce706fae96b04f08b99de9001fc262a0', 'request_id': 'req-22c92b86-c051-4b61-8031-97e6ef81aef5'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:19.166672 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce706fae96b04f08b99de9001fc262a0', 'request_id': 'req-22c92b86-c051-4b61-8031-97e6ef81aef5'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:19.196688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:19.202153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] The token cache is being invalidate because project ce706fae96b04f08b99de9001fc262a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:19.202460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:19.204610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-22c92b86-c051-4b61-8031-97e6ef81aef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:19.209600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 845/1683] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:18 2022] DELETE /identity/v3/projects/ce706fae96b04f08b99de9001fc262a0 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:19.217383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466de61-1048-4888-a67d-13561c34c7a5 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:19.217861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466de61-1048-4888-a67d-13561c34c7a5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:19.219496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466de61-1048-4888-a67d-13561c34c7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:19.279676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6466de61-1048-4888-a67d-13561c34c7a5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:19.287834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6466de61-1048-4888-a67d-13561c34c7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:19.391187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 839/1684] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:19.398880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536ebd-0349-4da3-8c75-4e82e43427ff None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:19.399292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536ebd-0349-4da3-8c75-4e82e43427ff None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:19.399681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536ebd-0349-4da3-8c75-4e82e43427ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:19.435297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f2536ebd-0349-4da3-8c75-4e82e43427ff None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:19.436709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f2536ebd-0349-4da3-8c75-4e82e43427ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:19.462337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466de61-1048-4888-a67d-13561c34c7a5 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:19.462530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 846/1685] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:19.480957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466de61-1048-4888-a67d-13561c34c7a5 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:19.490279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac5e38-6666-4349-940b-4d848ca29ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:19.491606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac5e38-6666-4349-940b-4d848ca29ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:19.492085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac5e38-6666-4349-940b-4d848ca29ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:19.493486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac5e38-6666-4349-940b-4d848ca29ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:19.494754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac5e38-6666-4349-940b-4d848ca29ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:19.500245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac5e38-6666-4349-940b-4d848ca29ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:19.500245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac5e38-6666-4349-940b-4d848ca29ae7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:19.530576 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 840/1686] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:19.535781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2536ebd-0349-4da3-8c75-4e82e43427ff None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:19.554902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2536ebd-0349-4da3-8c75-4e82e43427ff None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:19.555659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dfff1-fe86-449e-8157-ea6bda85e617 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:19.556019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dfff1-fe86-449e-8157-ea6bda85e617 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:19.556305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dfff1-fe86-449e-8157-ea6bda85e617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:19.567948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29027d77-44b8-4c8b-bec8-06ed4189c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:19.568650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29027d77-44b8-4c8b-bec8-06ed4189c7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:19.569409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29027d77-44b8-4c8b-bec8-06ed4189c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:19.569695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29027d77-44b8-4c8b-bec8-06ed4189c7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:19.570470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29027d77-44b8-4c8b-bec8-06ed4189c7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:19.574594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29027d77-44b8-4c8b-bec8-06ed4189c7a5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:19.628383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-398dfff1-fe86-449e-8157-ea6bda85e617 None None] MFA Rules not processed for user `52599ae5d7a045e6b6156352322e5642`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:19.630281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-398dfff1-fe86-449e-8157-ea6bda85e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:19.703500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 847/1687] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:19 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:19.704691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29027d77-44b8-4c8b-bec8-06ed4189c7a5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:19.714543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-29027d77-44b8-4c8b-bec8-06ed4189c7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:19.816601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 841/1688] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:19.817524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dfff1-fe86-449e-8157-ea6bda85e617 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:19.875575 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dfff1-fe86-449e-8157-ea6bda85e617 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:19.998816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29027d77-44b8-4c8b-bec8-06ed4189c7a5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:20.022387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:20.023531 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:20.024800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:20.025345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] PATH_INFO: `/v3/projects/a021f19d3d0a4d9da017530731b9cc13` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:20.030329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a021f19d3d0a4d9da017530731b9cc13)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:20.036331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:20.128387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30d699-bbb7-432b-94ed-2b27717a0880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:20.129257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30d699-bbb7-432b-94ed-2b27717a0880 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:20.129780 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30d699-bbb7-432b-94ed-2b27717a0880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:20.130169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30d699-bbb7-432b-94ed-2b27717a0880 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:20.130887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30d699-bbb7-432b-94ed-2b27717a0880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:20.133772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30d699-bbb7-432b-94ed-2b27717a0880 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:20.161233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:20.246085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 842/1689] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:19 2022] POST /identity/v3/users => generated 285 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:20.247415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30d699-bbb7-432b-94ed-2b27717a0880 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:20.271299 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30d699-bbb7-432b-94ed-2b27717a0880 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:20.277557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a021f19d3d0a4d9da017530731b9cc13', 'request_id': 'req-4bbe3cdb-4018-46a5-a021-96df0726a84f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.371497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a021f19d3d0a4d9da017530731b9cc13', 'request_id': 'req-4bbe3cdb-4018-46a5-a021-96df0726a84f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.400517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a021f19d3d0a4d9da017530731b9cc13', 'request_id': 'req-4bbe3cdb-4018-46a5-a021-96df0726a84f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.424079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] The token cache is being invalidate because project a021f19d3d0a4d9da017530731b9cc13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:20.424446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.426575 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.429622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 848/1690] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:19 2022] DELETE /identity/v3/projects/a021f19d3d0a4d9da017530731b9cc13 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:20.433374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74778-c41a-4825-9da2-53532c25738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:20.434166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74778-c41a-4825-9da2-53532c25738f admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:20.434394 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:20.434499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74778-c41a-4825-9da2-53532c25738f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:20.434739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74778-c41a-4825-9da2-53532c25738f admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:20.435502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd74778-c41a-4825-9da2-53532c25738f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:20.437170 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd74778-c41a-4825-9da2-53532c25738f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:20.438202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:20.455808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 843/1691] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:20.460559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74778-c41a-4825-9da2-53532c25738f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:20.467501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3cdb-4018-46a5-a021-96df0726a84f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:20.469324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6fd74778-c41a-4825-9da2-53532c25738f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:20.479935 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:20.489332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74778-c41a-4825-9da2-53532c25738f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:20.490591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:20.490895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:20.491188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] PATH_INFO: `/v3/users/be11764d1fbf4f09acb1a6085f3316b7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:20.495693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=be11764d1fbf4f09acb1a6085f3316b7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:20.498109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:20.506125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad016f7-574a-4b4b-b4e4-898795839d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:20.509073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad016f7-574a-4b4b-b4e4-898795839d56 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:20.509073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad016f7-574a-4b4b-b4e4-898795839d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:20.509073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad016f7-574a-4b4b-b4e4-898795839d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:20.509073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad016f7-574a-4b4b-b4e4-898795839d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:20.511098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad016f7-574a-4b4b-b4e4-898795839d56 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:20.541825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 844/1692] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:20.545909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad016f7-574a-4b4b-b4e4-898795839d56 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:20.567468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad016f7-574a-4b4b-b4e4-898795839d56 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:20.578720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c84c0-825d-4eb5-b7e6-9e0c174e8b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:20.579631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c84c0-825d-4eb5-b7e6-9e0c174e8b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:20.579927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c84c0-825d-4eb5-b7e6-9e0c174e8b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:20.580217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c84c0-825d-4eb5-b7e6-9e0c174e8b9b admin admin] PATH_INFO: `/v3/projects/af4f5718585540e584364d49d4e40c63/users/8dbc2f0fb30245b599c743f7016730cc/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:20.614135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c84c0-825d-4eb5-b7e6-9e0c174e8b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4f5718585540e584364d49d4e40c63, user_id=8dbc2f0fb30245b599c743f7016730cc, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:20.616932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c84c0-825d-4eb5-b7e6-9e0c174e8b9b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:20.713749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 845/1693] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:20 2022] PUT /identity/v3/projects/af4f5718585540e584364d49d4e40c63/users/8dbc2f0fb30245b599c743f7016730cc/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:20.726656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962727-c544-4192-92e5-8a50bbfc9e63 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:20.727196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962727-c544-4192-92e5-8a50bbfc9e63 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:20.727762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962727-c544-4192-92e5-8a50bbfc9e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:20.775539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be11764d1fbf4f09acb1a6085f3316b7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.809363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4c962727-c544-4192-92e5-8a50bbfc9e63 None None] MFA Rules not processed for user `8dbc2f0fb30245b599c743f7016730cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:20.810791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4c962727-c544-4192-92e5-8a50bbfc9e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:20.853795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be11764d1fbf4f09acb1a6085f3316b7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.893239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be11764d1fbf4f09acb1a6085f3316b7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.899957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be11764d1fbf4f09acb1a6085f3316b7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.923967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:20.934824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7296c2dc-5a06-438f-9fbd-fb4f53915a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be11764d1fbf4f09acb1a6085f3316b7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:20.940527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 846/1694] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:20.946471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c962727-c544-4192-92e5-8a50bbfc9e63 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:20.966697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 849/1695] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:20 2022] DELETE /identity/v3/users/be11764d1fbf4f09acb1a6085f3316b7 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:20.975306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa8e2-bdbd-4efd-bfd5-114371ccce2e None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:20.976133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa8e2-bdbd-4efd-bfd5-114371ccce2e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:20.977000 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa8e2-bdbd-4efd-bfd5-114371ccce2e None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:20.978624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 850/1696] 10.222.0.26 () {54 vars in 960 bytes} [Thu Jun 30 10:51:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:51:20.983933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca6322-8240-4c3b-bba6-b125272b4f3b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:20.986380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca6322-8240-4c3b-bba6-b125272b4f3b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:20.991917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca6322-8240-4c3b-bba6-b125272b4f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:21.033017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-68ca6322-8240-4c3b-bba6-b125272b4f3b None None] MFA Rules not processed for user `3238a52a3f6047e0acb0136ab39257e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:21.036222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-68ca6322-8240-4c3b-bba6-b125272b4f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:21.042481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:21.077192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c962727-c544-4192-92e5-8a50bbfc9e63 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:21.185432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 851/1697] 10.222.0.26 () {58 vars in 1057 bytes} [Thu Jun 30 10:51:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:21.194471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca6322-8240-4c3b-bba6-b125272b4f3b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:21.206659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca6322-8240-4c3b-bba6-b125272b4f3b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:21.225915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a782e-44c8-4794-acd0-cfc719f91cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:21.225915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a782e-44c8-4794-acd0-cfc719f91cde admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:21.225915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a782e-44c8-4794-acd0-cfc719f91cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:21.225915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a782e-44c8-4794-acd0-cfc719f91cde admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:21.226483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a782e-44c8-4794-acd0-cfc719f91cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:21.227383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3238a52a3f6047e0acb0136ab39257e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:21.228098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:21.229008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:21.229294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:21.236330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a782e-44c8-4794-acd0-cfc719f91cde admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:21.238167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:21.261703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:21.266954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:21.280147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 852/1698] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:21.362336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 847/1699] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:20 2022] POST /identity/v3/projects => generated 369 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:21.376192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:21.378680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:21.401490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6e026-790b-4e6c-b974-864f1c40dbff service placement] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:21.506784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3792f-50a4-4519-8aae-cc89e5af9ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:21.511794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3792f-50a4-4519-8aae-cc89e5af9ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:21.511794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3792f-50a4-4519-8aae-cc89e5af9ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:21.511794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3792f-50a4-4519-8aae-cc89e5af9ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:21.511794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3792f-50a4-4519-8aae-cc89e5af9ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:21.511794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3792f-50a4-4519-8aae-cc89e5af9ac5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:21.598118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a936187-2e38-4f34-9f92-0570f33eed32 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:21.599313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a936187-2e38-4f34-9f92-0570f33eed32 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:21.600041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a936187-2e38-4f34-9f92-0570f33eed32 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:21.602202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 848/1700] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jun 30 10:51:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:51:21.609147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f907b2-5304-479e-9671-69b1864ed2bf None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:21.615924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f907b2-5304-479e-9671-69b1864ed2bf None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:21.617741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f907b2-5304-479e-9671-69b1864ed2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:21.644661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 853/1701] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:21 2022] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:21.649496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3792f-50a4-4519-8aae-cc89e5af9ac5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:21.696793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3792f-50a4-4519-8aae-cc89e5af9ac5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:21.700525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f8f907b2-5304-479e-9671-69b1864ed2bf None None] MFA Rules not processed for user `719afb6dcb154119beb18d2f1974fe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:21.702400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f8f907b2-5304-479e-9671-69b1864ed2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:21.723714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af69c9-5861-418c-8113-7227b722ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:21.728723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af69c9-5861-418c-8113-7227b722ca85 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:21.728723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af69c9-5861-418c-8113-7227b722ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:21.728723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af69c9-5861-418c-8113-7227b722ca85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:21.728723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af69c9-5861-418c-8113-7227b722ca85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:21.737516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af69c9-5861-418c-8113-7227b722ca85 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:21.775501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 854/1702] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:21.779648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359625a-d794-4edf-bd6f-c3d2cea8ff3f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:21.782207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359625a-d794-4edf-bd6f-c3d2cea8ff3f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:21.782619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359625a-d794-4edf-bd6f-c3d2cea8ff3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:21.900244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-6359625a-d794-4edf-bd6f-c3d2cea8ff3f None None] MFA Rules not processed for user `60622199be2e44cd9c72f37c9d41e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:21.905349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6359625a-d794-4edf-bd6f-c3d2cea8ff3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:21.979052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 849/1703] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:51:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:21.979052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f907b2-5304-479e-9671-69b1864ed2bf None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:21.989227 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f907b2-5304-479e-9671-69b1864ed2bf None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:21.995943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028618-c2cb-4a1d-b022-458995222ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:22.003311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028618-c2cb-4a1d-b022-458995222ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:22.007488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028618-c2cb-4a1d-b022-458995222ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:22.007488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028618-c2cb-4a1d-b022-458995222ab0 admin admin] PATH_INFO: `/v3/projects/0fcd80f78f02405c97318b27f774740a/users/6423624553eb4838b32db59cc9e06e83/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:22.028242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 855/1704] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:22.040400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359625a-d794-4edf-bd6f-c3d2cea8ff3f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:22.041837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6359625a-d794-4edf-bd6f-c3d2cea8ff3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:22.048618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d028618-c2cb-4a1d-b022-458995222ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcd80f78f02405c97318b27f774740a, user_id=6423624553eb4838b32db59cc9e06e83, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:22.055500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359625a-d794-4edf-bd6f-c3d2cea8ff3f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:22.056536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d028618-c2cb-4a1d-b022-458995222ab0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:22.061741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aec7b-ada7-4e23-984b-2e5133b6e78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:22.062511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aec7b-ada7-4e23-984b-2e5133b6e78d service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:22.062805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aec7b-ada7-4e23-984b-2e5133b6e78d service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:22.063081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aec7b-ada7-4e23-984b-2e5133b6e78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:22.077651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aec7b-ada7-4e23-984b-2e5133b6e78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:22.079510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aec7b-ada7-4e23-984b-2e5133b6e78d service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:22.118425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 856/1705] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:22.119840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a5dc0-2c25-4bad-b63e-616e51681620 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:22.120143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a5dc0-2c25-4bad-b63e-616e51681620 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:22.120433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a5dc0-2c25-4bad-b63e-616e51681620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:22.143753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-876a5dc0-2c25-4bad-b63e-616e51681620 None None] MFA Rules not processed for user `60622199be2e44cd9c72f37c9d41e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:22.145276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-876a5dc0-2c25-4bad-b63e-616e51681620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:22.161561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 857/1706] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:22.167925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a5dc0-2c25-4bad-b63e-616e51681620 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:22.170439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-876a5dc0-2c25-4bad-b63e-616e51681620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:22.214650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 850/1707] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:21 2022] PUT /identity/v3/projects/0fcd80f78f02405c97318b27f774740a/users/6423624553eb4838b32db59cc9e06e83/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:22.219178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028618-c2cb-4a1d-b022-458995222ab0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:22.329254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:22.354297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028618-c2cb-4a1d-b022-458995222ab0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:22.359525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cd3a7-3d61-4f60-9808-294dd6d6987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:22.360468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd3a7-3d61-4f60-9808-294dd6d6987b admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:22.360971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd3a7-3d61-4f60-9808-294dd6d6987b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:22.361587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd3a7-3d61-4f60-9808-294dd6d6987b admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:22.362767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cd3a7-3d61-4f60-9808-294dd6d6987b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:22.365218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cd3a7-3d61-4f60-9808-294dd6d6987b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:22.368924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:22.377929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a5dc0-2c25-4bad-b63e-616e51681620 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:22.399025 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 851/1708] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:22.400166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cd3a7-3d61-4f60-9808-294dd6d6987b admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:22.402367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-286cd3a7-3d61-4f60-9808-294dd6d6987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:22.419102 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cd3a7-3d61-4f60-9808-294dd6d6987b admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:22.425745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:22.426914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:22.427368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:22.427813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] PATH_INFO: `/v3/projects/b37ba671de3d44adbc8635ff9c1b988d` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:22.429337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b37ba671de3d44adbc8635ff9c1b988d)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:22.431487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:22.506410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d77bd-603d-417e-b6dc-bb7776e65b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:22.507154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d77bd-603d-417e-b6dc-bb7776e65b03 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:22.507592 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d77bd-603d-417e-b6dc-bb7776e65b03 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:22.507871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d77bd-603d-417e-b6dc-bb7776e65b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:22.577988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37ba671de3d44adbc8635ff9c1b988d', 'request_id': 'req-18ce924e-3d47-4d0f-adc9-af4f79acd62b'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:22.615608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37ba671de3d44adbc8635ff9c1b988d', 'request_id': 'req-18ce924e-3d47-4d0f-adc9-af4f79acd62b'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:22.661520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d77bd-603d-417e-b6dc-bb7776e65b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:22.663353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d77bd-603d-417e-b6dc-bb7776e65b03 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:22.688191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 858/1709] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:22.689080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d77bd-603d-417e-b6dc-bb7776e65b03 service nova] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:22.715836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37ba671de3d44adbc8635ff9c1b988d', 'request_id': 'req-18ce924e-3d47-4d0f-adc9-af4f79acd62b'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:22.737826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] The token cache is being invalidate because project b37ba671de3d44adbc8635ff9c1b988d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:22.738264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:22.747695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-18ce924e-3d47-4d0f-adc9-af4f79acd62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:22.752951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 852/1710] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:22 2022] DELETE /identity/v3/projects/b37ba671de3d44adbc8635ff9c1b988d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:22.756068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d77bd-603d-417e-b6dc-bb7776e65b03 service nova] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:22.770741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2891ae3-d831-4bdf-9651-df84f9c7cd27 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:22.772348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2891ae3-d831-4bdf-9651-df84f9c7cd27 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:22.772960 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2891ae3-d831-4bdf-9651-df84f9c7cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:22.840932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f2891ae3-d831-4bdf-9651-df84f9c7cd27 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:22.848543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f2891ae3-d831-4bdf-9651-df84f9c7cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:22.950761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60dc92-f19a-4c3e-a8dd-4679634074d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:22.951684 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60dc92-f19a-4c3e-a8dd-4679634074d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:22.951984 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60dc92-f19a-4c3e-a8dd-4679634074d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:22.952272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60dc92-f19a-4c3e-a8dd-4679634074d8 admin admin] PATH_INFO: `/v3/projects/0fcd80f78f02405c97318b27f774740a/users/6423624553eb4838b32db59cc9e06e83/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:22.961547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60dc92-f19a-4c3e-a8dd-4679634074d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcd80f78f02405c97318b27f774740a, user_id=6423624553eb4838b32db59cc9e06e83, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:22.967360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60dc92-f19a-4c3e-a8dd-4679634074d8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:23.000584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 859/1711] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:22 2022] PUT /identity/v3/projects/0fcd80f78f02405c97318b27f774740a/users/6423624553eb4838b32db59cc9e06e83/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:23.002179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d730837-419f-4b25-9f6f-987d817f5a89 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:23.006774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d730837-419f-4b25-9f6f-987d817f5a89 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:23.007265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d730837-419f-4b25-9f6f-987d817f5a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:23.115399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 853/1712] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:23.126328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-2d730837-419f-4b25-9f6f-987d817f5a89 None None] MFA Rules not processed for user `6423624553eb4838b32db59cc9e06e83`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:23.126808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba767e-1a58-40ba-a898-3eba5901606e None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:23.126808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba767e-1a58-40ba-a898-3eba5901606e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:23.127060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba767e-1a58-40ba-a898-3eba5901606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:23.129909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2d730837-419f-4b25-9f6f-987d817f5a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:23.195052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c4ba767e-1a58-40ba-a898-3eba5901606e None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:23.201292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c4ba767e-1a58-40ba-a898-3eba5901606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:23.263347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 860/1713] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:23 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:23.273352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d730837-419f-4b25-9f6f-987d817f5a89 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:23.275712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2d730837-419f-4b25-9f6f-987d817f5a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:23.398033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d730837-419f-4b25-9f6f-987d817f5a89 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:23.403805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6157535-1612-4e81-b139-2405a8c7bf20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:23.405363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6157535-1612-4e81-b139-2405a8c7bf20 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:23.406024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6157535-1612-4e81-b139-2405a8c7bf20 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:23.406595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6157535-1612-4e81-b139-2405a8c7bf20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:23.408043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 854/1714] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:23.412179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba767e-1a58-40ba-a898-3eba5901606e None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:23.428468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba767e-1a58-40ba-a898-3eba5901606e None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:23.428952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6157535-1612-4e81-b139-2405a8c7bf20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:23.434209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6157535-1612-4e81-b139-2405a8c7bf20 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:23.434387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:23.435954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:23.436313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:23.436659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:23.437677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:23.438085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:23.439951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:23.461845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 861/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:23 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:23.479883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 855/1716] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:23.485550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6157535-1612-4e81-b139-2405a8c7bf20 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:23.503506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6157535-1612-4e81-b139-2405a8c7bf20 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:23.516311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:23.524266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae7199-dcda-4ec2-9d0f-3ff69653c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:23.525272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae7199-dcda-4ec2-9d0f-3ff69653c757 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:23.526467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae7199-dcda-4ec2-9d0f-3ff69653c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:23.526860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae7199-dcda-4ec2-9d0f-3ff69653c757 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:23.528145 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae7199-dcda-4ec2-9d0f-3ff69653c757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:23.530579 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae7199-dcda-4ec2-9d0f-3ff69653c757 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:23.588732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:23.591696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:23.605454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b976d1-001b-4b9c-b6a0-b1523d675617 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:23.614192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e3cb7-f4a0-47f9-ac2e-d1b485d11998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:23.614971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e3cb7-f4a0-47f9-ac2e-d1b485d11998 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:23.622373 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e3cb7-f4a0-47f9-ac2e-d1b485d11998 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:23.623627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e3cb7-f4a0-47f9-ac2e-d1b485d11998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:23.629074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e73e3cb7-f4a0-47f9-ac2e-d1b485d11998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:23.647179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:23.708730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 862/1717] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:23 2022] POST /identity/v3/projects => generated 363 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:23.716250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae7199-dcda-4ec2-9d0f-3ff69653c757 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:23.783808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e3cb7-f4a0-47f9-ac2e-d1b485d11998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:23.790618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e3cb7-f4a0-47f9-ac2e-d1b485d11998 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:23.825680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 856/1718] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:23.843173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae7199-dcda-4ec2-9d0f-3ff69653c757 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:23.852681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e864a3d-413f-4022-89e3-89bb192ba46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:23.853458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864a3d-413f-4022-89e3-89bb192ba46c admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:23.853932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864a3d-413f-4022-89e3-89bb192ba46c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:23.854427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864a3d-413f-4022-89e3-89bb192ba46c admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:23.855146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e864a3d-413f-4022-89e3-89bb192ba46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:23.864858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e864a3d-413f-4022-89e3-89bb192ba46c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:23.932461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2929-62fe-490e-9346-95aa8eb32306 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:23.932763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2929-62fe-490e-9346-95aa8eb32306 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:23.933056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2929-62fe-490e-9346-95aa8eb32306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:23.971936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 863/1719] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:23 2022] POST /identity/v3/users => generated 282 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:23.976611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e864a3d-413f-4022-89e3-89bb192ba46c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:23.999419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e864a3d-413f-4022-89e3-89bb192ba46c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:24.007804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d73653-0fe9-42c4-8044-6f5958b8c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:24.008915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a7ed2929-62fe-490e-9346-95aa8eb32306 None None] MFA Rules not processed for user `09664e6ce77d4f7690beea16a17d388f`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:24.009780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d73653-0fe9-42c4-8044-6f5958b8c80d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:24.011202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a7ed2929-62fe-490e-9346-95aa8eb32306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:24.012315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d73653-0fe9-42c4-8044-6f5958b8c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:24.012783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d73653-0fe9-42c4-8044-6f5958b8c80d admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:24.013760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d73653-0fe9-42c4-8044-6f5958b8c80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:24.019059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d73653-0fe9-42c4-8044-6f5958b8c80d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:24.045164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 864/1720] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:24.053344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d73653-0fe9-42c4-8044-6f5958b8c80d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:24.084418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d73653-0fe9-42c4-8044-6f5958b8c80d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:24.096309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4456e-a6eb-4c39-ac93-0e93ffba69a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:24.098875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4456e-a6eb-4c39-ac93-0e93ffba69a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:24.099859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4456e-a6eb-4c39-ac93-0e93ffba69a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:24.101649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4456e-a6eb-4c39-ac93-0e93ffba69a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:24.102880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4456e-a6eb-4c39-ac93-0e93ffba69a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:24.106963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4456e-a6eb-4c39-ac93-0e93ffba69a2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:24.147923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 865/1721] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:24.147923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4456e-a6eb-4c39-ac93-0e93ffba69a2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:24.195197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4456e-a6eb-4c39-ac93-0e93ffba69a2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:24.217648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead325f9-0913-4a01-b4e9-ab778be43423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:24.218827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead325f9-0913-4a01-b4e9-ab778be43423 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:24.220016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead325f9-0913-4a01-b4e9-ab778be43423 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:24.220463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead325f9-0913-4a01-b4e9-ab778be43423 admin admin] PATH_INFO: `/v3/projects/1d4020eec1524b6ba25caec5c615632a/users/aadeaa1c4fed4fbcad718f049c18e0b1/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:24.225711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 857/1722] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:24.232214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125e908-b0a1-4aba-bf2e-9e8194b31cbd None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:24.232746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125e908-b0a1-4aba-bf2e-9e8194b31cbd None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:24.241280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125e908-b0a1-4aba-bf2e-9e8194b31cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:24.302039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead325f9-0913-4a01-b4e9-ab778be43423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4020eec1524b6ba25caec5c615632a, user_id=aadeaa1c4fed4fbcad718f049c18e0b1, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:24.302039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead325f9-0913-4a01-b4e9-ab778be43423 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:24.336783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4125e908-b0a1-4aba-bf2e-9e8194b31cbd None None] MFA Rules not processed for user `b21bf3717c1045088c5f45a88b6c3b15`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:24.340121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4125e908-b0a1-4aba-bf2e-9e8194b31cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:24.451406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:24.455750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 866/1723] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:24 2022] PUT /identity/v3/projects/1d4020eec1524b6ba25caec5c615632a/users/aadeaa1c4fed4fbcad718f049c18e0b1/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:24.467037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90191c-5642-431c-9cdb-123d3d540f18 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:24.467334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90191c-5642-431c-9cdb-123d3d540f18 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:24.468120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90191c-5642-431c-9cdb-123d3d540f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:24.550195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 858/1724] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:24.550195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125e908-b0a1-4aba-bf2e-9e8194b31cbd None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:24.552671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1a90191c-5642-431c-9cdb-123d3d540f18 None None] MFA Rules not processed for user `aadeaa1c4fed4fbcad718f049c18e0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:24.565842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1a90191c-5642-431c-9cdb-123d3d540f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:24.569093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4125e908-b0a1-4aba-bf2e-9e8194b31cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:24.798416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 867/1725] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:24.805465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90191c-5642-431c-9cdb-123d3d540f18 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:24.844628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125e908-b0a1-4aba-bf2e-9e8194b31cbd None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:24.960075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90191c-5642-431c-9cdb-123d3d540f18 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:24.991911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299933ce-63aa-4190-b5bd-6c4b1b3c593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:24.993409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299933ce-63aa-4190-b5bd-6c4b1b3c593c admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:24.994591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299933ce-63aa-4190-b5bd-6c4b1b3c593c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:24.995042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299933ce-63aa-4190-b5bd-6c4b1b3c593c admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:24.996780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299933ce-63aa-4190-b5bd-6c4b1b3c593c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:24.999096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299933ce-63aa-4190-b5bd-6c4b1b3c593c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.071783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:25.118642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33455574-a03b-4e3a-bcdb-ce068940f3e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.120829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33455574-a03b-4e3a-bcdb-ce068940f3e0 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.122760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33455574-a03b-4e3a-bcdb-ce068940f3e0 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.123133 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33455574-a03b-4e3a-bcdb-ce068940f3e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.139935 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 868/1726] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:24 2022] POST /identity/v3/projects => generated 363 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:25.140785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299933ce-63aa-4190-b5bd-6c4b1b3c593c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.308111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299933ce-63aa-4190-b5bd-6c4b1b3c593c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.324504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a32b6-89da-4d73-8b32-a036c825235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.325586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a32b6-89da-4d73-8b32-a036c825235c admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.326064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a32b6-89da-4d73-8b32-a036c825235c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.326507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a32b6-89da-4d73-8b32-a036c825235c admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.327556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a32b6-89da-4d73-8b32-a036c825235c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.330408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a32b6-89da-4d73-8b32-a036c825235c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.367105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33455574-a03b-4e3a-bcdb-ce068940f3e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.371783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33455574-a03b-4e3a-bcdb-ce068940f3e0 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.384317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:25.401991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 859/1727] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:25.425778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33455574-a03b-4e3a-bcdb-ce068940f3e0 service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.436930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-33455574-a03b-4e3a-bcdb-ce068940f3e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:25.482886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 869/1728] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:25 2022] POST /identity/v3/users => generated 288 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:25.485384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33455574-a03b-4e3a-bcdb-ce068940f3e0 service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.491449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a32b6-89da-4d73-8b32-a036c825235c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.531360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a32b6-89da-4d73-8b32-a036c825235c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.547712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac18fb-b6d7-48cc-88a0-2aca8c74f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.548505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac18fb-b6d7-48cc-88a0-2aca8c74f014 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.550083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac18fb-b6d7-48cc-88a0-2aca8c74f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.553375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac18fb-b6d7-48cc-88a0-2aca8c74f014 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.553375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac18fb-b6d7-48cc-88a0-2aca8c74f014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.564035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac18fb-b6d7-48cc-88a0-2aca8c74f014 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.621480 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 870/1729] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:25.626284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac18fb-b6d7-48cc-88a0-2aca8c74f014 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.695549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac18fb-b6d7-48cc-88a0-2aca8c74f014 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.708522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522661b-694d-44d7-b995-46f982525636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.708893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522661b-694d-44d7-b995-46f982525636 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.709179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522661b-694d-44d7-b995-46f982525636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.711524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023fedd-cee6-467e-bfae-ae3616833a66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.712542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023fedd-cee6-467e-bfae-ae3616833a66 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.712829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023fedd-cee6-467e-bfae-ae3616833a66 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.713108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023fedd-cee6-467e-bfae-ae3616833a66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.713978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522661b-694d-44d7-b995-46f982525636 admin admin] PATH_INFO: `/v3/projects/243bde089ff548eab9bda565be7f2ddb/users/599b82d26277449eb93babeb61305128/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.759569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522661b-694d-44d7-b995-46f982525636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243bde089ff548eab9bda565be7f2ddb, user_id=599b82d26277449eb93babeb61305128, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.768668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522661b-694d-44d7-b995-46f982525636 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.863954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023fedd-cee6-467e-bfae-ae3616833a66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.865739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023fedd-cee6-467e-bfae-ae3616833a66 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.884474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 871/1730] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:25 2022] PUT /identity/v3/projects/243bde089ff548eab9bda565be7f2ddb/users/599b82d26277449eb93babeb61305128/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:25.888585 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522661b-694d-44d7-b995-46f982525636 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.907453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:25.931743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 860/1731] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:25.971714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42df73-8765-4aa9-98ec-cc6014c1136a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.972088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42df73-8765-4aa9-98ec-cc6014c1136a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.972510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42df73-8765-4aa9-98ec-cc6014c1136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.019804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4f42df73-8765-4aa9-98ec-cc6014c1136a None None] MFA Rules not processed for user `60622199be2e44cd9c72f37c9d41e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:26.021048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4f42df73-8765-4aa9-98ec-cc6014c1136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:26.143104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522661b-694d-44d7-b995-46f982525636 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:26.162404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ec8b-d214-497e-9848-3db035eb60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:26.165022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ec8b-d214-497e-9848-3db035eb60b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:26.168926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ec8b-d214-497e-9848-3db035eb60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:26.169679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ec8b-d214-497e-9848-3db035eb60b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.172156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ec8b-d214-497e-9848-3db035eb60b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:26.177165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ec8b-d214-497e-9848-3db035eb60b8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:26.225329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 872/1732] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:26.228706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ec8b-d214-497e-9848-3db035eb60b8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:26.245004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:26.284938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 861/1733] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:26.305851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ec8b-d214-497e-9848-3db035eb60b8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:26.322904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6d92c-c33a-4406-8ca0-acdd581f145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:26.324623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6d92c-c33a-4406-8ca0-acdd581f145f admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:26.325171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6d92c-c33a-4406-8ca0-acdd581f145f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:26.325653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6d92c-c33a-4406-8ca0-acdd581f145f admin admin] PATH_INFO: `/v3/projects/243bde089ff548eab9bda565be7f2ddb/users/599b82d26277449eb93babeb61305128/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.328758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6d92c-c33a-4406-8ca0-acdd581f145f admin admin] RBAC: Authorizing `identity:create_grant(project_id=243bde089ff548eab9bda565be7f2ddb, user_id=599b82d26277449eb93babeb61305128, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:26.332618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6d92c-c33a-4406-8ca0-acdd581f145f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:26.347298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 873/1734] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:26 2022] PUT /identity/v3/projects/243bde089ff548eab9bda565be7f2ddb/users/599b82d26277449eb93babeb61305128/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:26.357601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a370-028b-4c1d-9e30-d3d699ac5e85 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:26.357783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a370-028b-4c1d-9e30-d3d699ac5e85 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:26.358005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a370-028b-4c1d-9e30-d3d699ac5e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.459679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6aa1a370-028b-4c1d-9e30-d3d699ac5e85 None None] MFA Rules not processed for user `599b82d26277449eb93babeb61305128`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:26.460929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6aa1a370-028b-4c1d-9e30-d3d699ac5e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:26.667103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 862/1735] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:26 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:26.682401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6d92c-c33a-4406-8ca0-acdd581f145f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:26.872224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6d92c-c33a-4406-8ca0-acdd581f145f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:26.902319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89735096-d12b-42ee-bab3-8eac0ac22042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:26.903625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89735096-d12b-42ee-bab3-8eac0ac22042 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:26.905152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89735096-d12b-42ee-bab3-8eac0ac22042 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:26.906343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89735096-d12b-42ee-bab3-8eac0ac22042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.951345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89735096-d12b-42ee-bab3-8eac0ac22042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:26.953546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89735096-d12b-42ee-bab3-8eac0ac22042 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:26.967911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 874/1736] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:26 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:27.392965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0f2e7-49ab-4975-b443-209fa92b33dc None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:27.393543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0f2e7-49ab-4975-b443-209fa92b33dc None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:27.393785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0f2e7-49ab-4975-b443-209fa92b33dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:27.431943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:27.454356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e7e0f2e7-49ab-4975-b443-209fa92b33dc None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:27.457220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e7e0f2e7-49ab-4975-b443-209fa92b33dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:27.507205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89735096-d12b-42ee-bab3-8eac0ac22042 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:27.518068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89735096-d12b-42ee-bab3-8eac0ac22042 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:27.528969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d5ae-7d59-4f77-a17b-4960c6c4d19b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:27.529862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d5ae-7d59-4f77-a17b-4960c6c4d19b service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:27.530330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d5ae-7d59-4f77-a17b-4960c6c4d19b service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:27.530801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d5ae-7d59-4f77-a17b-4960c6c4d19b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:27.574774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:27.744319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 863/1737] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:51:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:27.795262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5d5ae-7d59-4f77-a17b-4960c6c4d19b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:27.809090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5d5ae-7d59-4f77-a17b-4960c6c4d19b service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:27.832787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 875/1738] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:28.321551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0f2e7-49ab-4975-b443-209fa92b33dc None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:28.323568 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e7e0f2e7-49ab-4975-b443-209fa92b33dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:28.480976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0f2e7-49ab-4975-b443-209fa92b33dc None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:28.507515 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d0d8d-0d71-4e31-b802-4c25bbc7fbea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:28.508556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0d8d-0d71-4e31-b802-4c25bbc7fbea service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:28.509131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0d8d-0d71-4e31-b802-4c25bbc7fbea service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:28.509539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0d8d-0d71-4e31-b802-4c25bbc7fbea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:28.542447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d0d8d-0d71-4e31-b802-4c25bbc7fbea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:28.544455 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d0d8d-0d71-4e31-b802-4c25bbc7fbea service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:28.586036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 864/1739] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:51:28.953222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d5ae-7d59-4f77-a17b-4960c6c4d19b service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:28.954585 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6fd5d5ae-7d59-4f77-a17b-4960c6c4d19b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:29.344966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d5ae-7d59-4f77-a17b-4960c6c4d19b service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:29.375102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:29.376282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:29.376731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:29.377744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] PATH_INFO: `/v3/users/109d92580d6c4083baf480f944d51d4d` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:29.387112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109d92580d6c4083baf480f944d51d4d)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:29.389302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:29.663519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109d92580d6c4083baf480f944d51d4d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:29.755619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109d92580d6c4083baf480f944d51d4d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:29.765180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:29.781102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109d92580d6c4083baf480f944d51d4d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:29.782136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109d92580d6c4083baf480f944d51d4d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:29.847970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109d92580d6c4083baf480f944d51d4d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:29.875270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 876/1740] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:28 2022] DELETE /identity/v3/users/109d92580d6c4083baf480f944d51d4d => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:29.880198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ba9a8-078b-4c55-a32d-cba722ec05b4 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:29.880700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ba9a8-078b-4c55-a32d-cba722ec05b4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:29.880700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ba9a8-078b-4c55-a32d-cba722ec05b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:29.949544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3e7ba9a8-078b-4c55-a32d-cba722ec05b4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:29.950864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3e7ba9a8-078b-4c55-a32d-cba722ec05b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:30.132334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 865/1741] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:30.173900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:30.176215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:30.344309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ebcbf-40f2-4456-ac26-f7cc56007f16 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:30.365085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9f6b0-8c9b-4a36-9b59-c44451b2e61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:30.365085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f6b0-8c9b-4a36-9b59-c44451b2e61b service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:30.365085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f6b0-8c9b-4a36-9b59-c44451b2e61b service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:30.365757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f6b0-8c9b-4a36-9b59-c44451b2e61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:30.387781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9f6b0-8c9b-4a36-9b59-c44451b2e61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:30.393531 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9f6b0-8c9b-4a36-9b59-c44451b2e61b service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:30.428499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 877/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:31.868484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ba9a8-078b-4c55-a32d-cba722ec05b4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:31.872711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3e7ba9a8-078b-4c55-a32d-cba722ec05b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:31.910366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ba9a8-078b-4c55-a32d-cba722ec05b4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:31.928597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:31.929697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:31.930121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:31.930555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] PATH_INFO: `/v3/users/8dbc2f0fb30245b599c743f7016730cc` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:31.932309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbc2f0fb30245b599c743f7016730cc)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:31.933591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: WARNING py.warnings [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:51:31.933591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: warnings.warn(msg) Jun 30 10:51:31.933591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: Jun 30 10:51:31.937927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:32.430383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9f6b0-8c9b-4a36-9b59-c44451b2e61b service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:32.430383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-36d9f6b0-8c9b-4a36-9b59-c44451b2e61b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:32.430876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbc2f0fb30245b599c743f7016730cc'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.430976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9f6b0-8c9b-4a36-9b59-c44451b2e61b service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:32.430976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:32.430976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:32.430976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:32.431296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] PATH_INFO: `/v3/projects/4c50cda040184455943e248fe9727bd5` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:32.431296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c50cda040184455943e248fe9727bd5)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:32.431296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:32.589209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbc2f0fb30245b599c743f7016730cc'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.593580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbc2f0fb30245b599c743f7016730cc'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.602844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:32.633336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbc2f0fb30245b599c743f7016730cc'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.634247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-be153ce9-f381-4c4f-ac61-92e15d544041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbc2f0fb30245b599c743f7016730cc'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.703265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 866/1743] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:31 2022] DELETE /identity/v3/users/8dbc2f0fb30245b599c743f7016730cc => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:32.704384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c50cda040184455943e248fe9727bd5', 'request_id': 'req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.704507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bd3f0-ef6c-4d10-93eb-8bf85303fae1 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:32.704800 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bd3f0-ef6c-4d10-93eb-8bf85303fae1 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:32.705089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bd3f0-ef6c-4d10-93eb-8bf85303fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:32.804845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-fe2bd3f0-ef6c-4d10-93eb-8bf85303fae1 None None] MFA Rules not processed for user `719afb6dcb154119beb18d2f1974fe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:32.809447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-fe2bd3f0-ef6c-4d10-93eb-8bf85303fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:32.812459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c50cda040184455943e248fe9727bd5', 'request_id': 'req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.822700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c50cda040184455943e248fe9727bd5', 'request_id': 'req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.865052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] The token cache is being invalidate because project 4c50cda040184455943e248fe9727bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:32.865400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.866201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6e2355ab-8f0c-4266-9c52-e8de6bc144a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:32.873716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 878/1744] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:32 2022] DELETE /identity/v3/projects/4c50cda040184455943e248fe9727bd5 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:32.873716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c9eac-e0be-4fda-b797-138dba55423c None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:32.873716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c9eac-e0be-4fda-b797-138dba55423c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:32.873716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c9eac-e0be-4fda-b797-138dba55423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:32.948098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 867/1745] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Jun 30 10:51:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:32.951808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bd3f0-ef6c-4d10-93eb-8bf85303fae1 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:32.957380 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-fe2bd3f0-ef6c-4d10-93eb-8bf85303fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:32.962667 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c52c9eac-e0be-4fda-b797-138dba55423c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:32.963834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c52c9eac-e0be-4fda-b797-138dba55423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:33.095772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bd3f0-ef6c-4d10-93eb-8bf85303fae1 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:33.102647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:33.103512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:33.103804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:33.104250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] PATH_INFO: `/v3/users/a32f48dedce4448aa93c796c8aea7dba` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:33.106420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32f48dedce4448aa93c796c8aea7dba)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:33.111813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:33.219770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 879/1746] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:33.219770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c9eac-e0be-4fda-b797-138dba55423c None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:33.221141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c52c9eac-e0be-4fda-b797-138dba55423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:33.240237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c9eac-e0be-4fda-b797-138dba55423c None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:33.246122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:33.247128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:33.247454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:33.247751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] PATH_INFO: `/v3/users/aadeaa1c4fed4fbcad718f049c18e0b1` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:33.249261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadeaa1c4fed4fbcad718f049c18e0b1)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:33.251676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:33.255809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:33.446915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32f48dedce4448aa93c796c8aea7dba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.516300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32f48dedce4448aa93c796c8aea7dba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.519690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32f48dedce4448aa93c796c8aea7dba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.569213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32f48dedce4448aa93c796c8aea7dba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.570664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32f48dedce4448aa93c796c8aea7dba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.573027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadeaa1c4fed4fbcad718f049c18e0b1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.611798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 868/1747] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:32 2022] DELETE /identity/v3/users/a32f48dedce4448aa93c796c8aea7dba => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:33.613603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:33.615028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:33.652136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadeaa1c4fed4fbcad718f049c18e0b1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.684303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadeaa1c4fed4fbcad718f049c18e0b1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.684303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadeaa1c4fed4fbcad718f049c18e0b1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.691397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadeaa1c4fed4fbcad718f049c18e0b1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:33.699927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 880/1748] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:33 2022] DELETE /identity/v3/users/aadeaa1c4fed4fbcad718f049c18e0b1 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:33.701267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:33.703823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:33.721232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed134-9fb5-46fa-8f12-91b5eb9ced0a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:33.866120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1cf6f-1a31-4aa8-894a-cf5dcd28b063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:33.866836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1cf6f-1a31-4aa8-894a-cf5dcd28b063 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:33.867113 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1cf6f-1a31-4aa8-894a-cf5dcd28b063 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:33.873579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1cf6f-1a31-4aa8-894a-cf5dcd28b063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:33.896320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3af1cf6f-1a31-4aa8-894a-cf5dcd28b063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:33.960928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1cf6f-1a31-4aa8-894a-cf5dcd28b063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:33.967865 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1cf6f-1a31-4aa8-894a-cf5dcd28b063 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:34.023185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 869/1749] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:34.034935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1cf6f-1a31-4aa8-894a-cf5dcd28b063 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:34.037705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409581d5-0af2-4baf-99aa-05a69bfbbe80 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:34.049746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267eda5-a997-447a-beac-497f502d3047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:34.055134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267eda5-a997-447a-beac-497f502d3047 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:34.055540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267eda5-a997-447a-beac-497f502d3047 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:34.056985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267eda5-a997-447a-beac-497f502d3047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:34.062517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1cf6f-1a31-4aa8-894a-cf5dcd28b063 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:34.063628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0267eda5-a997-447a-beac-497f502d3047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:34.078542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221010b7-9b2d-4bef-af41-55f37288a72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:34.079794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221010b7-9b2d-4bef-af41-55f37288a72e service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:34.081436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221010b7-9b2d-4bef-af41-55f37288a72e service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:34.081966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221010b7-9b2d-4bef-af41-55f37288a72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:34.108123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221010b7-9b2d-4bef-af41-55f37288a72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:34.114986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221010b7-9b2d-4bef-af41-55f37288a72e service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:34.142630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 870/1750] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:34.147708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221010b7-9b2d-4bef-af41-55f37288a72e service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:34.153799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-221010b7-9b2d-4bef-af41-55f37288a72e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:34.195206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221010b7-9b2d-4bef-af41-55f37288a72e service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:34.221667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daddeb9-2a23-4763-9427-be8b571b88d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:34.223158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daddeb9-2a23-4763-9427-be8b571b88d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:34.226683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daddeb9-2a23-4763-9427-be8b571b88d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:34.396807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daddeb9-2a23-4763-9427-be8b571b88d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:34.396807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daddeb9-2a23-4763-9427-be8b571b88d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:34.396807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daddeb9-2a23-4763-9427-be8b571b88d8 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:34.396807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 871/1751] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:34.396807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf1363-e88a-406d-81a8-f4618a449b20 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:34.396807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf1363-e88a-406d-81a8-f4618a449b20 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:34.398560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf1363-e88a-406d-81a8-f4618a449b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:34.399932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267eda5-a997-447a-beac-497f502d3047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:34.399932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267eda5-a997-447a-beac-497f502d3047 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:34.400462 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9caf1363-e88a-406d-81a8-f4618a449b20 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:34.400926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 881/1752] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:34.401154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9caf1363-e88a-406d-81a8-f4618a449b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:34.401154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 872/1753] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:34.538962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267eda5-a997-447a-beac-497f502d3047 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:34.556166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267eda5-a997-447a-beac-497f502d3047 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:34.569909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75680009-644c-4a02-8f34-8852aec1eb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:34.570759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75680009-644c-4a02-8f34-8852aec1eb40 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:34.571163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75680009-644c-4a02-8f34-8852aec1eb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:34.571564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75680009-644c-4a02-8f34-8852aec1eb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:34.608822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75680009-644c-4a02-8f34-8852aec1eb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:34.608822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75680009-644c-4a02-8f34-8852aec1eb40 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:34.629473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 882/1754] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:34.854841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908184c3-b42b-49de-9758-0394d53550f8 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:34.854961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908184c3-b42b-49de-9758-0394d53550f8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:34.855216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908184c3-b42b-49de-9758-0394d53550f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:34.923012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-908184c3-b42b-49de-9758-0394d53550f8 None None] MFA Rules not processed for user `09664e6ce77d4f7690beea16a17d388f`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:34.923012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-908184c3-b42b-49de-9758-0394d53550f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:35.009245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 873/1755] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:35.172710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:36.359278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75680009-644c-4a02-8f34-8852aec1eb40 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:36.361342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-75680009-644c-4a02-8f34-8852aec1eb40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:36.402661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75680009-644c-4a02-8f34-8852aec1eb40 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:36.426446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:36.427560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:36.427659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:36.427915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] PATH_INFO: `/v3/projects/af4f5718585540e584364d49d4e40c63` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:36.430117 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4f5718585540e584364d49d4e40c63)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:36.432457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:36.475750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:36.707692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e4a3-5ed1-4d09-926a-6f15668f20db None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:36.707692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e4a3-5ed1-4d09-926a-6f15668f20db None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:36.707692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e4a3-5ed1-4d09-926a-6f15668f20db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:36.766203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f281e4a3-5ed1-4d09-926a-6f15668f20db None None] MFA Rules not processed for user `b21bf3717c1045088c5f45a88b6c3b15`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:36.770254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f281e4a3-5ed1-4d09-926a-6f15668f20db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:36.913504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4f5718585540e584364d49d4e40c63', 'request_id': 'req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.000030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 874/1756] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:37.001021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281e4a3-5ed1-4d09-926a-6f15668f20db None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:37.007433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f281e4a3-5ed1-4d09-926a-6f15668f20db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:37.059494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281e4a3-5ed1-4d09-926a-6f15668f20db None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:37.094747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4f5718585540e584364d49d4e40c63', 'request_id': 'req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.107212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4f5718585540e584364d49d4e40c63', 'request_id': 'req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.151355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:37.153871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] The token cache is being invalidate because project af4f5718585540e584364d49d4e40c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:37.154205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.162266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.166330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 883/1757] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:36 2022] DELETE /identity/v3/projects/af4f5718585540e584364d49d4e40c63 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:37.171185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:37.178304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:37.225358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:37.226517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:37.226975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:37.247228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] PATH_INFO: `/v3/projects/3bf7ee15c7374fdc88403bb29e2636db` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:37.248854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf7ee15c7374fdc88403bb29e2636db)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:37.251113 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:37.333790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec6194-d5a7-4117-b0f5-b78b32cd5e98 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:37.351626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:37.352572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:37.352875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:37.353293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] PATH_INFO: `/v3/users/6423624553eb4838b32db59cc9e06e83` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:37.354798 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6423624553eb4838b32db59cc9e06e83)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:37.357059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:37.540561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf7ee15c7374fdc88403bb29e2636db', 'request_id': 'req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.577472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf7ee15c7374fdc88403bb29e2636db', 'request_id': 'req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.834725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf7ee15c7374fdc88403bb29e2636db', 'request_id': 'req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.859615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] The token cache is being invalidate because project 3bf7ee15c7374fdc88403bb29e2636db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:37.863363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.868822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.876552 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 875/1758] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:37 2022] DELETE /identity/v3/projects/3bf7ee15c7374fdc88403bb29e2636db => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:37.883415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:37.885699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6423624553eb4838b32db59cc9e06e83'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:37.933024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:38.121325 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6423624553eb4838b32db59cc9e06e83'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:38.139581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ae7aa-8f4f-4e5b-a688-6413e7469ba3 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:38.150265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:38.161095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:38.161406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:38.161704 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] PATH_INFO: `/v3/projects/1d4020eec1524b6ba25caec5c615632a` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:38.163154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4020eec1524b6ba25caec5c615632a)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:38.165149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:38.167537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6423624553eb4838b32db59cc9e06e83'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:38.174589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6423624553eb4838b32db59cc9e06e83'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:38.189971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:38.200460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-084d026f-37fb-4ded-b122-ea241a3fdf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6423624553eb4838b32db59cc9e06e83'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:38.228688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 884/1759] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:37 2022] DELETE /identity/v3/users/6423624553eb4838b32db59cc9e06e83 => generated 0 bytes in 1058 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:38.231331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200f37-88f5-4cf0-b2ba-5b9bce2806c1 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:38.234754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200f37-88f5-4cf0-b2ba-5b9bce2806c1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:38.235758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200f37-88f5-4cf0-b2ba-5b9bce2806c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:38.308222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a7200f37-88f5-4cf0-b2ba-5b9bce2806c1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:38.312508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a7200f37-88f5-4cf0-b2ba-5b9bce2806c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:38.349699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4020eec1524b6ba25caec5c615632a', 'request_id': 'req-6cf8835c-468a-4026-9092-2f2613b11a87'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:38.370809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4020eec1524b6ba25caec5c615632a', 'request_id': 'req-6cf8835c-468a-4026-9092-2f2613b11a87'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:38.435140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4020eec1524b6ba25caec5c615632a', 'request_id': 'req-6cf8835c-468a-4026-9092-2f2613b11a87'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:38.450733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] The token cache is being invalidate because project 1d4020eec1524b6ba25caec5c615632a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:38.451043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:38.453609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:38.458244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 876/1760] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:37 2022] DELETE /identity/v3/projects/1d4020eec1524b6ba25caec5c615632a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:38.463046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:38.471838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:38.536422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 885/1761] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:38.586422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b78c68-b376-4d3a-87d6-f5d7519dd1f6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:38.586763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b78c68-b376-4d3a-87d6-f5d7519dd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:38.588770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b78c68-b376-4d3a-87d6-f5d7519dd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:38.682362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b4b78c68-b376-4d3a-87d6-f5d7519dd1f6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:38.687853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b4b78c68-b376-4d3a-87d6-f5d7519dd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:38.729207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8835c-468a-4026-9092-2f2613b11a87 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:38.730780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 886/1762] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:38.736274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddb8ba-4c98-476d-a855-a035e33a11cd None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:38.739580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:38.743951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:38.743951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:38.743951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] PATH_INFO: `/v3/users/599b82d26277449eb93babeb61305128` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:38.744586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddb8ba-4c98-476d-a855-a035e33a11cd None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:38.744586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddb8ba-4c98-476d-a855-a035e33a11cd None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:38.748637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 887/1763] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:51:38 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:51:38.753196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599b82d26277449eb93babeb61305128)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:38.755243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:38.755669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddb8ba-4c98-476d-a855-a035e33a11cd None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:38.813793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddb8ba-4c98-476d-a855-a035e33a11cd None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:38.858805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aad4df-411a-4a9a-8b01-ec7df9911c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:38.862821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aad4df-411a-4a9a-8b01-ec7df9911c42 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:38.865808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aad4df-411a-4a9a-8b01-ec7df9911c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:38.869644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aad4df-411a-4a9a-8b01-ec7df9911c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:38.870818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aad4df-411a-4a9a-8b01-ec7df9911c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:38.871254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aad4df-411a-4a9a-8b01-ec7df9911c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:38.873145 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aad4df-411a-4a9a-8b01-ec7df9911c42 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:38.904885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 888/1764] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:38.906842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd5ff-9958-499a-8ac2-b307a9c3edcd None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:38.907247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd5ff-9958-499a-8ac2-b307a9c3edcd None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:38.907638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd5ff-9958-499a-8ac2-b307a9c3edcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:38.956901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d1afd5ff-9958-499a-8ac2-b307a9c3edcd None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:38.959463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d1afd5ff-9958-499a-8ac2-b307a9c3edcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:39.143353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 889/1765] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:51:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:39.143353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afd5ff-9958-499a-8ac2-b307a9c3edcd None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:39.172039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afd5ff-9958-499a-8ac2-b307a9c3edcd None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:39.183058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f148e-e1f4-4298-993e-6c72a6c3854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:39.183866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f148e-e1f4-4298-993e-6c72a6c3854b admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:39.184762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f148e-e1f4-4298-993e-6c72a6c3854b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:39.184762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f148e-e1f4-4298-993e-6c72a6c3854b admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:39.185583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f148e-e1f4-4298-993e-6c72a6c3854b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:39.195242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f148e-e1f4-4298-993e-6c72a6c3854b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:39.243351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599b82d26277449eb93babeb61305128'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:39.256962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:39.435879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599b82d26277449eb93babeb61305128'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:39.439796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599b82d26277449eb93babeb61305128'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:39.448124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 890/1766] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:39 2022] POST /identity/v3/projects => generated 387 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:39.449538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4397db-f2de-4ef5-aa23-528b1c23d241 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:39.449841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4397db-f2de-4ef5-aa23-528b1c23d241 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:39.450189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4397db-f2de-4ef5-aa23-528b1c23d241 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:39.451672 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 891/1767] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:51:39.452678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4397db-f2de-4ef5-aa23-528b1c23d241 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:39.464925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599b82d26277449eb93babeb61305128'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:39.466260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-01862493-b5b0-4243-976e-09dc98d83bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599b82d26277449eb93babeb61305128'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:39.469546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cc4397db-f2de-4ef5-aa23-528b1c23d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:39.495494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 877/1768] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:38 2022] DELETE /identity/v3/users/599b82d26277449eb93babeb61305128 => generated 0 bytes in 1034 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:39.497273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8d91-87b0-497e-bbf2-16dfdcb20b5d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:39.497727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8d91-87b0-497e-bbf2-16dfdcb20b5d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:39.498510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8d91-87b0-497e-bbf2-16dfdcb20b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:39.663550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-66bf8d91-87b0-497e-bbf2-16dfdcb20b5d None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:39.663550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-66bf8d91-87b0-497e-bbf2-16dfdcb20b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:39.701576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4397db-f2de-4ef5-aa23-528b1c23d241 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:39.798731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 878/1769] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:51:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:39.886921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaacafc-ae0a-4626-875d-8245194505ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:39.889093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaacafc-ae0a-4626-875d-8245194505ba admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:39.889924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaacafc-ae0a-4626-875d-8245194505ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:39.891974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaacafc-ae0a-4626-875d-8245194505ba admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:39.893067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaacafc-ae0a-4626-875d-8245194505ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:39.896767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaacafc-ae0a-4626-875d-8245194505ba admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:40.027137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 892/1770] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:39 2022] POST /identity/v3/users => generated 294 bytes in 575 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:40.031801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8d91-87b0-497e-bbf2-16dfdcb20b5d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:40.055953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8d91-87b0-497e-bbf2-16dfdcb20b5d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:40.071044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43d8cc-9eab-4c09-837e-13625c273bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:40.074260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43d8cc-9eab-4c09-837e-13625c273bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:40.075007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43d8cc-9eab-4c09-837e-13625c273bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:40.075445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43d8cc-9eab-4c09-837e-13625c273bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:40.077612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43d8cc-9eab-4c09-837e-13625c273bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:40.085706 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43d8cc-9eab-4c09-837e-13625c273bb9 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:40.126886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaacafc-ae0a-4626-875d-8245194505ba admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:40.135047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 879/1771] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:40.142966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaacafc-ae0a-4626-875d-8245194505ba admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:40.156330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329243ff-d120-4df6-9f3e-4aca37695f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:40.157026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329243ff-d120-4df6-9f3e-4aca37695f78 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:40.157327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329243ff-d120-4df6-9f3e-4aca37695f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:40.157637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329243ff-d120-4df6-9f3e-4aca37695f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:40.161494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329243ff-d120-4df6-9f3e-4aca37695f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:40.168233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329243ff-d120-4df6-9f3e-4aca37695f78 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:40.194513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 893/1772] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:40.196446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43d8cc-9eab-4c09-837e-13625c273bb9 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:40.213315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43d8cc-9eab-4c09-837e-13625c273bb9 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:40.232470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4b616-719a-4278-97f9-3d0273cebfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:40.233724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4b616-719a-4278-97f9-3d0273cebfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:40.234220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4b616-719a-4278-97f9-3d0273cebfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:40.238372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4b616-719a-4278-97f9-3d0273cebfd2 admin admin] PATH_INFO: `/v3/projects/853a54efb736491c9e56b545cfaaae40/users/5938367e043b40109fecc6dcc6feaeee/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:40.275161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4b616-719a-4278-97f9-3d0273cebfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853a54efb736491c9e56b545cfaaae40, user_id=5938367e043b40109fecc6dcc6feaeee, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:40.284202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4b616-719a-4278-97f9-3d0273cebfd2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:40.489122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 880/1773] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:40 2022] PUT /identity/v3/projects/853a54efb736491c9e56b545cfaaae40/users/5938367e043b40109fecc6dcc6feaeee/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:40.502313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67110-7b5e-4530-ad5e-73cc0211a762 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:40.504155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67110-7b5e-4530-ad5e-73cc0211a762 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:40.504467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67110-7b5e-4530-ad5e-73cc0211a762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:40.576199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-e6b67110-7b5e-4530-ad5e-73cc0211a762 None None] MFA Rules not processed for user `5938367e043b40109fecc6dcc6feaeee`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:40.577492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e6b67110-7b5e-4530-ad5e-73cc0211a762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:40.690114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 894/1774] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:40.695522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4b616-719a-4278-97f9-3d0273cebfd2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:40.898180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4b616-719a-4278-97f9-3d0273cebfd2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:40.904103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a4c29-3ce2-4369-b4d6-b6376f424944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:40.907399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a4c29-3ce2-4369-b4d6-b6376f424944 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:40.907399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a4c29-3ce2-4369-b4d6-b6376f424944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:40.907399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a4c29-3ce2-4369-b4d6-b6376f424944 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:40.907399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a4c29-3ce2-4369-b4d6-b6376f424944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:40.908347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a4c29-3ce2-4369-b4d6-b6376f424944 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:40.999738 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67110-7b5e-4530-ad5e-73cc0211a762 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:41.001362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e6b67110-7b5e-4530-ad5e-73cc0211a762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:41.026814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67110-7b5e-4530-ad5e-73cc0211a762 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:41.075429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 881/1775] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:40 2022] POST /identity/v3/projects => generated 385 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:41.077351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a4c29-3ce2-4369-b4d6-b6376f424944 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:41.091876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:41.098880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:41.098880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:41.098880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] PATH_INFO: `/v3/projects/0fcd80f78f02405c97318b27f774740a` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:41.098880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fcd80f78f02405c97318b27f774740a)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:41.100184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:41.303756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a4c29-3ce2-4369-b4d6-b6376f424944 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:41.303756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f363df9-eb00-4c12-9c4a-e0b333b34e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:41.303756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f363df9-eb00-4c12-9c4a-e0b333b34e6f admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:41.303756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f363df9-eb00-4c12-9c4a-e0b333b34e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:41.305442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f363df9-eb00-4c12-9c4a-e0b333b34e6f admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:41.305442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f363df9-eb00-4c12-9c4a-e0b333b34e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:41.305442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f363df9-eb00-4c12-9c4a-e0b333b34e6f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:41.436328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 882/1776] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:41 2022] POST /identity/v3/users => generated 299 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:41.437465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f363df9-eb00-4c12-9c4a-e0b333b34e6f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:41.458207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9f363df9-eb00-4c12-9c4a-e0b333b34e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:41.458570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcd80f78f02405c97318b27f774740a', 'request_id': 'req-fb572cac-408a-4f2a-8f2b-74c6a66784d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:41.595180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f363df9-eb00-4c12-9c4a-e0b333b34e6f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:41.600695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcd80f78f02405c97318b27f774740a', 'request_id': 'req-fb572cac-408a-4f2a-8f2b-74c6a66784d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:41.608729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcd80f78f02405c97318b27f774740a', 'request_id': 'req-fb572cac-408a-4f2a-8f2b-74c6a66784d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:41.669446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] The token cache is being invalidate because project 0fcd80f78f02405c97318b27f774740a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:41.669756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:41.671636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:41.694515 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 895/1777] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:40 2022] DELETE /identity/v3/projects/0fcd80f78f02405c97318b27f774740a => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:41.694515 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:41.699127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:41.775241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fbc5b-ad4b-4668-942f-433bedcbc46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:41.779187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fbc5b-ad4b-4668-942f-433bedcbc46a service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:41.779187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fbc5b-ad4b-4668-942f-433bedcbc46a service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:41.779187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fbc5b-ad4b-4668-942f-433bedcbc46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:41.779187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d27fbc5b-ad4b-4668-942f-433bedcbc46a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:41.809317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fbc5b-ad4b-4668-942f-433bedcbc46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:41.811097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fbc5b-ad4b-4668-942f-433bedcbc46a service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:41.839905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 883/1778] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:41.839905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8268e-fa61-4b26-8f07-ad45d81d2c48 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:41.839905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8268e-fa61-4b26-8f07-ad45d81d2c48 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:41.839905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8268e-fa61-4b26-8f07-ad45d81d2c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:41.864571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb572cac-408a-4f2a-8f2b-74c6a66784d4 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:41.869752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6d86e-ee6f-4254-ae65-85103b6d8fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:41.871580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d86e-ee6f-4254-ae65-85103b6d8fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:41.871580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d86e-ee6f-4254-ae65-85103b6d8fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:41.871580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d86e-ee6f-4254-ae65-85103b6d8fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:41.872364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6d86e-ee6f-4254-ae65-85103b6d8fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:41.874334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6d86e-ee6f-4254-ae65-85103b6d8fb8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:41.875356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-cdd8268e-fa61-4b26-8f07-ad45d81d2c48 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:41.876595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-cdd8268e-fa61-4b26-8f07-ad45d81d2c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:41.886170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 896/1779] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:41.887130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6d86e-ee6f-4254-ae65-85103b6d8fb8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:41.887934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 884/1780] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:41.896865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4ed6d86e-ee6f-4254-ae65-85103b6d8fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:41.910166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8268e-fa61-4b26-8f07-ad45d81d2c48 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:41.912930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-cdd8268e-fa61-4b26-8f07-ad45d81d2c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:41.952798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8268e-fa61-4b26-8f07-ad45d81d2c48 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:41.964825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928863-f8e5-4e1f-bb31-ebb538fe083a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:41.965362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6d86e-ee6f-4254-ae65-85103b6d8fb8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:41.965482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928863-f8e5-4e1f-bb31-ebb538fe083a service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:41.965778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928863-f8e5-4e1f-bb31-ebb538fe083a service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:41.966110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928863-f8e5-4e1f-bb31-ebb538fe083a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:41.968304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4e928863-f8e5-4e1f-bb31-ebb538fe083a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:41.972189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:41.973416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:41.973801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:41.974210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] PATH_INFO: `/v3/projects/243bde089ff548eab9bda565be7f2ddb` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:41.975764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243bde089ff548eab9bda565be7f2ddb)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:41.979112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:41.995058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e928863-f8e5-4e1f-bb31-ebb538fe083a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:41.998812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e928863-f8e5-4e1f-bb31-ebb538fe083a service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:42.013099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 885/1781] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:42.014279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928863-f8e5-4e1f-bb31-ebb538fe083a service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:42.026183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928863-f8e5-4e1f-bb31-ebb538fe083a service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:42.033135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4a88b-f290-4461-ba80-a93dbf2ce6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:42.037825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a88b-f290-4461-ba80-a93dbf2ce6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.037825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a88b-f290-4461-ba80-a93dbf2ce6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.037825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a88b-f290-4461-ba80-a93dbf2ce6d0 admin admin] PATH_INFO: `/v3/projects/32aa7df179d34c31ada062d7406a908a/users/46ce82cc297349c68d2453c9a4f6a877/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.063278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4a88b-f290-4461-ba80-a93dbf2ce6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32aa7df179d34c31ada062d7406a908a, user_id=46ce82cc297349c68d2453c9a4f6a877, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:42.068483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4a88b-f290-4461-ba80-a93dbf2ce6d0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:42.167301 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 886/1782] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:42 2022] PUT /identity/v3/projects/32aa7df179d34c31ada062d7406a908a/users/46ce82cc297349c68d2453c9a4f6a877/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:42.170377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950ac44-a3d8-41e7-b4b3-36a1df162159 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.170886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950ac44-a3d8-41e7-b4b3-36a1df162159 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.171359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950ac44-a3d8-41e7-b4b3-36a1df162159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.219406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c950ac44-a3d8-41e7-b4b3-36a1df162159 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:42.223428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c950ac44-a3d8-41e7-b4b3-36a1df162159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:42.224208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243bde089ff548eab9bda565be7f2ddb', 'request_id': 'req-415b7483-706a-4b10-bbef-7bd802380279'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:42.298673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243bde089ff548eab9bda565be7f2ddb', 'request_id': 'req-415b7483-706a-4b10-bbef-7bd802380279'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:42.309356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243bde089ff548eab9bda565be7f2ddb', 'request_id': 'req-415b7483-706a-4b10-bbef-7bd802380279'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:42.339661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] The token cache is being invalidate because project 243bde089ff548eab9bda565be7f2ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:42.339964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:42.342947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:42.345972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 897/1783] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:41 2022] DELETE /identity/v3/projects/243bde089ff548eab9bda565be7f2ddb => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:42.349439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:42.353974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:42.463253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 887/1784] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:42.465554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836e414-4a8f-49d1-ab6c-fd6c6398cc69 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.472638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836e414-4a8f-49d1-ab6c-fd6c6398cc69 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.473178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836e414-4a8f-49d1-ab6c-fd6c6398cc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.570083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4836e414-4a8f-49d1-ab6c-fd6c6398cc69 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:42.572564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4836e414-4a8f-49d1-ab6c-fd6c6398cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:42.592365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 888/1785] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:42.593971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836e414-4a8f-49d1-ab6c-fd6c6398cc69 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:42.614009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b7483-706a-4b10-bbef-7bd802380279 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:42.617245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:42.619912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de1182-331c-4c3e-a984-3a3d02fe7259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:42.620787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de1182-331c-4c3e-a984-3a3d02fe7259 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.620891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de1182-331c-4c3e-a984-3a3d02fe7259 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.621127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de1182-331c-4c3e-a984-3a3d02fe7259 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.621874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de1182-331c-4c3e-a984-3a3d02fe7259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:42.623549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de1182-331c-4c3e-a984-3a3d02fe7259 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:42.633480 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836e414-4a8f-49d1-ab6c-fd6c6398cc69 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:42.641834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11468e5d-a1f7-4a2d-9f50-a4a17e93909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:42.642992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 898/1786] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:42.643420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11468e5d-a1f7-4a2d-9f50-a4a17e93909c admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.643851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11468e5d-a1f7-4a2d-9f50-a4a17e93909c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.644270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11468e5d-a1f7-4a2d-9f50-a4a17e93909c admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.644367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18552a5-6327-4944-baef-4da9939b9ec2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.644636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18552a5-6327-4944-baef-4da9939b9ec2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.646036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11468e5d-a1f7-4a2d-9f50-a4a17e93909c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:42.649470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11468e5d-a1f7-4a2d-9f50-a4a17e93909c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:42.649589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18552a5-6327-4944-baef-4da9939b9ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.649689 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11468e5d-a1f7-4a2d-9f50-a4a17e93909c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:42.683605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 889/1787] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:42.683605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11468e5d-a1f7-4a2d-9f50-a4a17e93909c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:42.701908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a18552a5-6327-4944-baef-4da9939b9ec2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:42.703166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a18552a5-6327-4944-baef-4da9939b9ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:42.713790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11468e5d-a1f7-4a2d-9f50-a4a17e93909c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:42.723452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 899/1788] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:42.724467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18552a5-6327-4944-baef-4da9939b9ec2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:42.727184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064b58a-dd9a-4c07-8432-73422284bfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:42.728404 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064b58a-dd9a-4c07-8432-73422284bfd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.729578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064b58a-dd9a-4c07-8432-73422284bfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.729784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064b58a-dd9a-4c07-8432-73422284bfd0 admin admin] PATH_INFO: `/v3/projects/32aa7df179d34c31ada062d7406a908a/users/46ce82cc297349c68d2453c9a4f6a877/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.739496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064b58a-dd9a-4c07-8432-73422284bfd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32aa7df179d34c31ada062d7406a908a, user_id=46ce82cc297349c68d2453c9a4f6a877, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:42.751017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064b58a-dd9a-4c07-8432-73422284bfd0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:42.754476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18552a5-6327-4944-baef-4da9939b9ec2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:42.766410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2039682-9508-4512-98a6-2ca53ffda24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:42.767510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2039682-9508-4512-98a6-2ca53ffda24c admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.767852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2039682-9508-4512-98a6-2ca53ffda24c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.768276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2039682-9508-4512-98a6-2ca53ffda24c admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.769010 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2039682-9508-4512-98a6-2ca53ffda24c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:42.771328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2039682-9508-4512-98a6-2ca53ffda24c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:42.783914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 890/1789] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:42 2022] PUT /identity/v3/projects/32aa7df179d34c31ada062d7406a908a/users/46ce82cc297349c68d2453c9a4f6a877/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:42.783914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064b58a-dd9a-4c07-8432-73422284bfd0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:42.864031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064b58a-dd9a-4c07-8432-73422284bfd0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:42.878713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740c5c6-c74f-49ee-af94-dc6bd1ebaa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:42.879456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740c5c6-c74f-49ee-af94-dc6bd1ebaa41 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.879749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740c5c6-c74f-49ee-af94-dc6bd1ebaa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.880032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740c5c6-c74f-49ee-af94-dc6bd1ebaa41 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.880898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740c5c6-c74f-49ee-af94-dc6bd1ebaa41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:42.881213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740c5c6-c74f-49ee-af94-dc6bd1ebaa41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:42.882977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740c5c6-c74f-49ee-af94-dc6bd1ebaa41 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:42.898110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 891/1790] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:42.899647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27286bf-3b3c-4f49-9d0c-74e585c0e73a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:42.899988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27286bf-3b3c-4f49-9d0c-74e585c0e73a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:42.900282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27286bf-3b3c-4f49-9d0c-74e585c0e73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:42.917438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 900/1791] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:42 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:42.926542 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2039682-9508-4512-98a6-2ca53ffda24c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:42.951788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-d27286bf-3b3c-4f49-9d0c-74e585c0e73a None None] MFA Rules not processed for user `46ce82cc297349c68d2453c9a4f6a877`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:42.953413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d27286bf-3b3c-4f49-9d0c-74e585c0e73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:43.032082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2039682-9508-4512-98a6-2ca53ffda24c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.042067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e71f-0f6d-4a2b-b94e-2f72ead7c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.043931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e71f-0f6d-4a2b-b94e-2f72ead7c15e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.044324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e71f-0f6d-4a2b-b94e-2f72ead7c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.044876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e71f-0f6d-4a2b-b94e-2f72ead7c15e admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.046337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e71f-0f6d-4a2b-b94e-2f72ead7c15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.051086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e71f-0f6d-4a2b-b94e-2f72ead7c15e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.083992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 892/1792] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:43.084974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27286bf-3b3c-4f49-9d0c-74e585c0e73a None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.115976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27286bf-3b3c-4f49-9d0c-74e585c0e73a None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.125198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cc63b-68e5-4e56-ad7a-94926e7cded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.126297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cc63b-68e5-4e56-ad7a-94926e7cded4 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.126752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cc63b-68e5-4e56-ad7a-94926e7cded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.127381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cc63b-68e5-4e56-ad7a-94926e7cded4 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.130012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cc63b-68e5-4e56-ad7a-94926e7cded4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.133439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cc63b-68e5-4e56-ad7a-94926e7cded4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.160757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 901/1793] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:42 2022] POST /identity/v3/projects => generated 369 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:43.162008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e71f-0f6d-4a2b-b94e-2f72ead7c15e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.165274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-11e3e71f-0f6d-4a2b-b94e-2f72ead7c15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:43.258071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 893/1794] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:43 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:43.258071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cc63b-68e5-4e56-ad7a-94926e7cded4 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.286502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cc63b-68e5-4e56-ad7a-94926e7cded4 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.313081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e71f-0f6d-4a2b-b94e-2f72ead7c15e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.318236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798f7ea-0af7-4f2e-ad08-e8c8b8108df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.318959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798f7ea-0af7-4f2e-ad08-e8c8b8108df5 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.319245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798f7ea-0af7-4f2e-ad08-e8c8b8108df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.319520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798f7ea-0af7-4f2e-ad08-e8c8b8108df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.376893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746d9a1-6caa-427a-b969-7d3e925dfde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.377515 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746d9a1-6caa-427a-b969-7d3e925dfde4 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.377834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746d9a1-6caa-427a-b969-7d3e925dfde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.378371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746d9a1-6caa-427a-b969-7d3e925dfde4 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.379086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746d9a1-6caa-427a-b969-7d3e925dfde4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.381481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746d9a1-6caa-427a-b969-7d3e925dfde4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.404336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:43.450560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798f7ea-0af7-4f2e-ad08-e8c8b8108df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.452037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798f7ea-0af7-4f2e-ad08-e8c8b8108df5 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.465609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 894/1795] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:43 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:43.466596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746d9a1-6caa-427a-b969-7d3e925dfde4 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.484351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746d9a1-6caa-427a-b969-7d3e925dfde4 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.490297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 902/1796] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:43.491543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798f7ea-0af7-4f2e-ad08-e8c8b8108df5 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.494609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c3bca-7f75-47f7-81c6-664ac2e5b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.495804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c3bca-7f75-47f7-81c6-664ac2e5b348 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.496349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c3bca-7f75-47f7-81c6-664ac2e5b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.497253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c3bca-7f75-47f7-81c6-664ac2e5b348 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.498287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c3bca-7f75-47f7-81c6-664ac2e5b348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.500640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c3bca-7f75-47f7-81c6-664ac2e5b348 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.529520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 895/1797] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:43.530427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c3bca-7f75-47f7-81c6-664ac2e5b348 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.531235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798f7ea-0af7-4f2e-ad08-e8c8b8108df5 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.538074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41ca32-640a-40cf-b491-5746aabc5696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.538977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41ca32-640a-40cf-b491-5746aabc5696 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.539531 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41ca32-640a-40cf-b491-5746aabc5696 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.539813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41ca32-640a-40cf-b491-5746aabc5696 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.541447 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41ca32-640a-40cf-b491-5746aabc5696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.543631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41ca32-640a-40cf-b491-5746aabc5696 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.556309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c3bca-7f75-47f7-81c6-664ac2e5b348 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.556309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.556309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.556309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.556952 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] PATH_INFO: `/v3/users/5938367e043b40109fecc6dcc6feaeee` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.556952 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5938367e043b40109fecc6dcc6feaeee)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.557824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.558787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 903/1798] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:43.563423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41ca32-640a-40cf-b491-5746aabc5696 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.581512 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41ca32-640a-40cf-b491-5746aabc5696 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.586833 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8561-ecaf-43c1-bfde-076ce4093a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.587802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8561-ecaf-43c1-bfde-076ce4093a16 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.588095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8561-ecaf-43c1-bfde-076ce4093a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.588374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8561-ecaf-43c1-bfde-076ce4093a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.589139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a8561-ecaf-43c1-bfde-076ce4093a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.591189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a8561-ecaf-43c1-bfde-076ce4093a16 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.604348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 904/1799] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:43.608754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8561-ecaf-43c1-bfde-076ce4093a16 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.620837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8561-ecaf-43c1-bfde-076ce4093a16 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.640976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb10af5-c0ad-4982-a7ae-1258ba673b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.642018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10af5-c0ad-4982-a7ae-1258ba673b97 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.642492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10af5-c0ad-4982-a7ae-1258ba673b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.642928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10af5-c0ad-4982-a7ae-1258ba673b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.645694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb10af5-c0ad-4982-a7ae-1258ba673b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.647867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb10af5-c0ad-4982-a7ae-1258ba673b97 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.676304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 905/1800] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:43.677573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb10af5-c0ad-4982-a7ae-1258ba673b97 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.688320 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb10af5-c0ad-4982-a7ae-1258ba673b97 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.694161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687c5ea-e0b3-46c2-8e00-1ba44ccf24c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.699724 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687c5ea-e0b3-46c2-8e00-1ba44ccf24c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.699724 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687c5ea-e0b3-46c2-8e00-1ba44ccf24c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.699724 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687c5ea-e0b3-46c2-8e00-1ba44ccf24c2 admin admin] PATH_INFO: `/v3/projects/e05bf3b2806b47c4a4e0032a17a42936/users/f2f975b5e54d472aaf3631a53b7b5875/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.713757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687c5ea-e0b3-46c2-8e00-1ba44ccf24c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05bf3b2806b47c4a4e0032a17a42936, user_id=f2f975b5e54d472aaf3631a53b7b5875, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.717165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687c5ea-e0b3-46c2-8e00-1ba44ccf24c2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:43.850195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 906/1801] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:43 2022] PUT /identity/v3/projects/e05bf3b2806b47c4a4e0032a17a42936/users/f2f975b5e54d472aaf3631a53b7b5875/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:43.850195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687c5ea-e0b3-46c2-8e00-1ba44ccf24c2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:43.937143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687c5ea-e0b3-46c2-8e00-1ba44ccf24c2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:43.943349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd37f7-254d-4aa8-a64e-cb2195677ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:43.943505 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5938367e043b40109fecc6dcc6feaeee'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:43.944269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd37f7-254d-4aa8-a64e-cb2195677ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:43.944556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd37f7-254d-4aa8-a64e-cb2195677ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:43.945876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd37f7-254d-4aa8-a64e-cb2195677ae0 admin admin] PATH_INFO: `/v3/projects/f45f5503bd1f436783f170843efc26c4/users/21ca820be67c449494aa137bfb8b4a07/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:43.961840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd37f7-254d-4aa8-a64e-cb2195677ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45f5503bd1f436783f170843efc26c4, user_id=21ca820be67c449494aa137bfb8b4a07, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:43.964901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd37f7-254d-4aa8-a64e-cb2195677ae0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.028673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5938367e043b40109fecc6dcc6feaeee'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:44.029332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5938367e043b40109fecc6dcc6feaeee'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:44.042086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5938367e043b40109fecc6dcc6feaeee'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:44.043250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f34f33d3-95be-4dcf-84e9-76230f01dce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5938367e043b40109fecc6dcc6feaeee'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:44.055135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 896/1802] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:43 2022] DELETE /identity/v3/users/5938367e043b40109fecc6dcc6feaeee => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:44.056411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8867a9-0140-4c86-8bec-7bb854e2ed8e None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.056703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8867a9-0140-4c86-8bec-7bb854e2ed8e None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.057034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8867a9-0140-4c86-8bec-7bb854e2ed8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.075149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 907/1803] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:43 2022] PUT /identity/v3/projects/f45f5503bd1f436783f170843efc26c4/users/21ca820be67c449494aa137bfb8b4a07/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:44.086370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc6ec7-513b-4017-b577-80619ae70217 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.086370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc6ec7-513b-4017-b577-80619ae70217 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.086370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc6ec7-513b-4017-b577-80619ae70217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.097415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-8b8867a9-0140-4c86-8bec-7bb854e2ed8e None None] MFA Rules not processed for user `f2f975b5e54d472aaf3631a53b7b5875`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:44.098663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8b8867a9-0140-4c86-8bec-7bb854e2ed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:44.098800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7ccc6ec7-513b-4017-b577-80619ae70217 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:44.099833 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7ccc6ec7-513b-4017-b577-80619ae70217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:44.159997 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 908/1804] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:44.161191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a3346-c757-4b35-9f94-9359df17dbb5 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.161490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a3346-c757-4b35-9f94-9359df17dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.161771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a3346-c757-4b35-9f94-9359df17dbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.165487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 897/1805] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:44.169604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8867a9-0140-4c86-8bec-7bb854e2ed8e None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.171123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8b8867a9-0140-4c86-8bec-7bb854e2ed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:44.189164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c84a3346-c757-4b35-9f94-9359df17dbb5 None None] MFA Rules not processed for user `21ca820be67c449494aa137bfb8b4a07`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:44.190965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c84a3346-c757-4b35-9f94-9359df17dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:44.227836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8867a9-0140-4c86-8bec-7bb854e2ed8e None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.231605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48dd2-b2b7-4b69-8ee3-859c9fccb39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.232255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48dd2-b2b7-4b69-8ee3-859c9fccb39d service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.232543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48dd2-b2b7-4b69-8ee3-859c9fccb39d service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.232821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48dd2-b2b7-4b69-8ee3-859c9fccb39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.242797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48dd2-b2b7-4b69-8ee3-859c9fccb39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.246238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48dd2-b2b7-4b69-8ee3-859c9fccb39d service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.254734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 898/1806] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:44.255232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48dd2-b2b7-4b69-8ee3-859c9fccb39d service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.256659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c9b48dd2-b2b7-4b69-8ee3-859c9fccb39d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:44.256774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 909/1807] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:44.260774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a3346-c757-4b35-9f94-9359df17dbb5 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.263025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c84a3346-c757-4b35-9f94-9359df17dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:44.278016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a3346-c757-4b35-9f94-9359df17dbb5 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.284599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58becd6-b31f-48b9-96f7-f79e3a14f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.292331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58becd6-b31f-48b9-96f7-f79e3a14f8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.292331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58becd6-b31f-48b9-96f7-f79e3a14f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.292331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58becd6-b31f-48b9-96f7-f79e3a14f8b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.292685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48dd2-b2b7-4b69-8ee3-859c9fccb39d service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.292762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58becd6-b31f-48b9-96f7-f79e3a14f8b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.292762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58becd6-b31f-48b9-96f7-f79e3a14f8b5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.292898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02ec8b-4b95-4773-9293-6e49ad059dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.292898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02ec8b-4b95-4773-9293-6e49ad059dbf admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.293573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02ec8b-4b95-4773-9293-6e49ad059dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.294082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02ec8b-4b95-4773-9293-6e49ad059dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.294998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02ec8b-4b95-4773-9293-6e49ad059dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.298559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02ec8b-4b95-4773-9293-6e49ad059dbf admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.396056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 910/1808] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:44 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:44.400003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58becd6-b31f-48b9-96f7-f79e3a14f8b5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.429677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 899/1809] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:44 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:44.431372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02ec8b-4b95-4773-9293-6e49ad059dbf admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.472301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58becd6-b31f-48b9-96f7-f79e3a14f8b5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.508642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02ec8b-4b95-4773-9293-6e49ad059dbf admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.515512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b9dad-a18d-46e7-b9ff-b543ed745b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.516783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b9dad-a18d-46e7-b9ff-b543ed745b84 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.516783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b9dad-a18d-46e7-b9ff-b543ed745b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.516953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b9dad-a18d-46e7-b9ff-b543ed745b84 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.517658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b9dad-a18d-46e7-b9ff-b543ed745b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.519719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b9dad-a18d-46e7-b9ff-b543ed745b84 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.547551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d655ed-c8c5-4728-a46c-f50b5f27dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.547551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d655ed-c8c5-4728-a46c-f50b5f27dd20 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.547551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d655ed-c8c5-4728-a46c-f50b5f27dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.547551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d655ed-c8c5-4728-a46c-f50b5f27dd20 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.548330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d655ed-c8c5-4728-a46c-f50b5f27dd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.550871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d655ed-c8c5-4728-a46c-f50b5f27dd20 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.629924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 900/1810] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:44 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:44.630692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 911/1811] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:44 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:44.633831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b9dad-a18d-46e7-b9ff-b543ed745b84 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.633995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d655ed-c8c5-4728-a46c-f50b5f27dd20 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.644841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d655ed-c8c5-4728-a46c-f50b5f27dd20 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.645050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b9dad-a18d-46e7-b9ff-b543ed745b84 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.649503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cef39a-53c0-46c0-b514-420e0c9de940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.649753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9220-bede-45bc-ad77-425a1700f2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.650352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cef39a-53c0-46c0-b514-420e0c9de940 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.650539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9220-bede-45bc-ad77-425a1700f2ad admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.650643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cef39a-53c0-46c0-b514-420e0c9de940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.650900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cef39a-53c0-46c0-b514-420e0c9de940 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.651014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9220-bede-45bc-ad77-425a1700f2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.651355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9220-bede-45bc-ad77-425a1700f2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.651594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cef39a-53c0-46c0-b514-420e0c9de940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.652442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e9220-bede-45bc-ad77-425a1700f2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.653206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cef39a-53c0-46c0-b514-420e0c9de940 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.654267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e9220-bede-45bc-ad77-425a1700f2ad admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.669536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 912/1812] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:51:44.672045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 901/1813] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:44.672908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cef39a-53c0-46c0-b514-420e0c9de940 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.682072 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9220-bede-45bc-ad77-425a1700f2ad admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.687978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c28e9220-bede-45bc-ad77-425a1700f2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:44.693691 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cef39a-53c0-46c0-b514-420e0c9de940 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.699335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdb94e-1d4f-4a15-96e6-9c8a0716921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.701659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdb94e-1d4f-4a15-96e6-9c8a0716921f admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.701659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdb94e-1d4f-4a15-96e6-9c8a0716921f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.701659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdb94e-1d4f-4a15-96e6-9c8a0716921f admin admin] PATH_INFO: `/v3/projects/96f3be11705b4567ad4378b4903f66f0/users/98657c85be744b1f87f6af32d3358bbe/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.708623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9220-bede-45bc-ad77-425a1700f2ad admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.714055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.715889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.716181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.716463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] PATH_INFO: `/v3/projects/853a54efb736491c9e56b545cfaaae40` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.717690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853a54efb736491c9e56b545cfaaae40)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.720527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.727799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdb94e-1d4f-4a15-96e6-9c8a0716921f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f3be11705b4567ad4378b4903f66f0, user_id=98657c85be744b1f87f6af32d3358bbe, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.730624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdb94e-1d4f-4a15-96e6-9c8a0716921f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:44.823237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 902/1814] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:44 2022] PUT /identity/v3/projects/96f3be11705b4567ad4378b4903f66f0/users/98657c85be744b1f87f6af32d3358bbe/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:44.824047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdb94e-1d4f-4a15-96e6-9c8a0716921f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.847481 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853a54efb736491c9e56b545cfaaae40', 'request_id': 'req-469a7587-a23e-4cb7-9f0e-56c526c66f17'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:44.884503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdb94e-1d4f-4a15-96e6-9c8a0716921f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:44.901219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853a54efb736491c9e56b545cfaaae40', 'request_id': 'req-469a7587-a23e-4cb7-9f0e-56c526c66f17'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:44.919918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853a54efb736491c9e56b545cfaaae40', 'request_id': 'req-469a7587-a23e-4cb7-9f0e-56c526c66f17'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:44.935324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] The token cache is being invalidate because project 853a54efb736491c9e56b545cfaaae40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:44.935838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:44.937357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:44.939223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 913/1815] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:44 2022] DELETE /identity/v3/projects/853a54efb736491c9e56b545cfaaae40 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:44.940438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:44.942053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:44.958683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f969a83-3557-49ec-846f-95d4a5be614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:44.960131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969a83-3557-49ec-846f-95d4a5be614a admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:44.960131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969a83-3557-49ec-846f-95d4a5be614a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:44.960324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969a83-3557-49ec-846f-95d4a5be614a admin admin] PATH_INFO: `/v3/projects/ebc58bc6083348d4900eeb8d791a04d6/users/343dee1bf0414ca7bd70cb881646e59d/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:44.972881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:44.979505 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f969a83-3557-49ec-846f-95d4a5be614a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc58bc6083348d4900eeb8d791a04d6, user_id=343dee1bf0414ca7bd70cb881646e59d, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:44.982298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f969a83-3557-49ec-846f-95d4a5be614a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.054245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 903/1816] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:44 2022] PUT /identity/v3/projects/ebc58bc6083348d4900eeb8d791a04d6/users/343dee1bf0414ca7bd70cb881646e59d/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:45.055257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f969a83-3557-49ec-846f-95d4a5be614a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:45.057078 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9f969a83-3557-49ec-846f-95d4a5be614a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:45.071128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7587-a23e-4cb7-9f0e-56c526c66f17 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:45.086294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:45.139257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f969a83-3557-49ec-846f-95d4a5be614a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:45.143973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5943178-3e1f-424b-9b1d-287f7cc0349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:45.144413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:45.144663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943178-3e1f-424b-9b1d-287f7cc0349f admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.144952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943178-3e1f-424b-9b1d-287f7cc0349f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.145241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943178-3e1f-424b-9b1d-287f7cc0349f admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.145350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.145551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.145823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] PATH_INFO: `/v3/users/46ce82cc297349c68d2453c9a4f6a877` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.146011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5943178-3e1f-424b-9b1d-287f7cc0349f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:45.147183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ce82cc297349c68d2453c9a4f6a877)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:45.147610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5943178-3e1f-424b-9b1d-287f7cc0349f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.149458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.161729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 914/1817] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:45.162967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5943178-3e1f-424b-9b1d-287f7cc0349f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:45.164838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a5943178-3e1f-424b-9b1d-287f7cc0349f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:45.178352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5943178-3e1f-424b-9b1d-287f7cc0349f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:45.183478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b41c25-99e0-420b-817a-2a688bbf9ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:45.184186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b41c25-99e0-420b-817a-2a688bbf9ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.184462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b41c25-99e0-420b-817a-2a688bbf9ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.184834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b41c25-99e0-420b-817a-2a688bbf9ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.185577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b41c25-99e0-420b-817a-2a688bbf9ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:45.187312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b41c25-99e0-420b-817a-2a688bbf9ed8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.198832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 915/1818] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:45.201894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b41c25-99e0-420b-817a-2a688bbf9ed8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:45.211801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b41c25-99e0-420b-817a-2a688bbf9ed8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:45.217037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69cdb7-0665-4e8c-b43c-d5b84d95bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:45.218050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69cdb7-0665-4e8c-b43c-d5b84d95bae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.222877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69cdb7-0665-4e8c-b43c-d5b84d95bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.222877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69cdb7-0665-4e8c-b43c-d5b84d95bae2 admin admin] PATH_INFO: `/v3/projects/96f3be11705b4567ad4378b4903f66f0/users/98657c85be744b1f87f6af32d3358bbe/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.222877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69cdb7-0665-4e8c-b43c-d5b84d95bae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f3be11705b4567ad4378b4903f66f0, user_id=98657c85be744b1f87f6af32d3358bbe, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:45.224011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69cdb7-0665-4e8c-b43c-d5b84d95bae2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.236827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 916/1819] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:45 2022] PUT /identity/v3/projects/96f3be11705b4567ad4378b4903f66f0/users/98657c85be744b1f87f6af32d3358bbe/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:45.242154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69cdb7-0665-4e8c-b43c-d5b84d95bae2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:45.299409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69cdb7-0665-4e8c-b43c-d5b84d95bae2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:45.304188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5efab-11c5-43b2-b717-70568ccca7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:45.305081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5efab-11c5-43b2-b717-70568ccca7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.305370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5efab-11c5-43b2-b717-70568ccca7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.305655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5efab-11c5-43b2-b717-70568ccca7ec admin admin] PATH_INFO: `/v3/projects/ebc58bc6083348d4900eeb8d791a04d6/users/343dee1bf0414ca7bd70cb881646e59d/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.307867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5efab-11c5-43b2-b717-70568ccca7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc58bc6083348d4900eeb8d791a04d6, user_id=343dee1bf0414ca7bd70cb881646e59d, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:45.310607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5efab-11c5-43b2-b717-70568ccca7ec admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.311761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ce82cc297349c68d2453c9a4f6a877'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:45.321359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 917/1820] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:45 2022] PUT /identity/v3/projects/ebc58bc6083348d4900eeb8d791a04d6/users/343dee1bf0414ca7bd70cb881646e59d/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:45.322672 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301194-4280-4450-8653-88614d7f1ec9 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.322972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301194-4280-4450-8653-88614d7f1ec9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.323257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301194-4280-4450-8653-88614d7f1ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.350464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-9b301194-4280-4450-8653-88614d7f1ec9 None None] MFA Rules not processed for user `98657c85be744b1f87f6af32d3358bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:45.351691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9b301194-4280-4450-8653-88614d7f1ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:45.377296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ce82cc297349c68d2453c9a4f6a877'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:45.378500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ce82cc297349c68d2453c9a4f6a877'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:45.394469 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ce82cc297349c68d2453c9a4f6a877'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:45.395286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f63571c0-bd94-4b99-9fa5-565d798b8030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ce82cc297349c68d2453c9a4f6a877'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:45.408643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 904/1821] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:45 2022] DELETE /identity/v3/users/46ce82cc297349c68d2453c9a4f6a877 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:45.410054 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437266a3-9c6f-44eb-a437-562687de1297 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.411874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437266a3-9c6f-44eb-a437-562687de1297 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.411874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437266a3-9c6f-44eb-a437-562687de1297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.440551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-437266a3-9c6f-44eb-a437-562687de1297 None None] MFA Rules not processed for user `343dee1bf0414ca7bd70cb881646e59d`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:45.441926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-437266a3-9c6f-44eb-a437-562687de1297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:45.521869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 905/1822] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:45.532944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437266a3-9c6f-44eb-a437-562687de1297 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:45.534365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-437266a3-9c6f-44eb-a437-562687de1297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:45.554390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 918/1823] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:45.566224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b301194-4280-4450-8653-88614d7f1ec9 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:45.570697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9b301194-4280-4450-8653-88614d7f1ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:45.599097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437266a3-9c6f-44eb-a437-562687de1297 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:45.603353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342204f9-1df7-40c6-9684-116a07f67c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:45.604254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342204f9-1df7-40c6-9684-116a07f67c4a service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.605030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342204f9-1df7-40c6-9684-116a07f67c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.605030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342204f9-1df7-40c6-9684-116a07f67c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.617198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342204f9-1df7-40c6-9684-116a07f67c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:45.618903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342204f9-1df7-40c6-9684-116a07f67c4a service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.626761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:45.634549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 906/1824] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:45.640185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b301194-4280-4450-8653-88614d7f1ec9 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:45.644482 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63c9dc-3104-49c0-9096-b7cf2274a632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:45.645185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63c9dc-3104-49c0-9096-b7cf2274a632 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.645503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63c9dc-3104-49c0-9096-b7cf2274a632 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.645832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63c9dc-3104-49c0-9096-b7cf2274a632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.704003 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342204f9-1df7-40c6-9684-116a07f67c4a service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:45.705440 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-342204f9-1df7-40c6-9684-116a07f67c4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:45.712834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63c9dc-3104-49c0-9096-b7cf2274a632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:45.714872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63c9dc-3104-49c0-9096-b7cf2274a632 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.726993 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 919/1825] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:45.788752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342204f9-1df7-40c6-9684-116a07f67c4a service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:45.801150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:45.801848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.802196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.802482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] PATH_INFO: `/v3/users/f2f975b5e54d472aaf3631a53b7b5875` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.805574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f975b5e54d472aaf3631a53b7b5875)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:45.807752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.854968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63c9dc-3104-49c0-9096-b7cf2274a632 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:45.854968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5c63c9dc-3104-49c0-9096-b7cf2274a632 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:45.875705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63c9dc-3104-49c0-9096-b7cf2274a632 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:45.897026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:45.897916 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:45.898427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:45.898547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] PATH_INFO: `/v3/projects/32aa7df179d34c31ada062d7406a908a` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:45.899924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] RBAC: Authorizing `identity:delete_project(project_id=32aa7df179d34c31ada062d7406a908a)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:45.902276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:45.912748 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:46.034437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f975b5e54d472aaf3631a53b7b5875'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.038325 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32aa7df179d34c31ada062d7406a908a', 'request_id': 'req-b226af34-bf71-49fb-9d28-2bcb42de891f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.125930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f975b5e54d472aaf3631a53b7b5875'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.127288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f975b5e54d472aaf3631a53b7b5875'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.141791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f975b5e54d472aaf3631a53b7b5875'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.142624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-689f6f19-532d-453c-a901-19f58135ed44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f975b5e54d472aaf3631a53b7b5875'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.161626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 907/1826] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:45 2022] DELETE /identity/v3/users/f2f975b5e54d472aaf3631a53b7b5875 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:46.166013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d69ad-ad2a-4294-aa95-676995fc4ee2 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.168843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d69ad-ad2a-4294-aa95-676995fc4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.168843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d69ad-ad2a-4294-aa95-676995fc4ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.184119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-935d69ad-ad2a-4294-aa95-676995fc4ee2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:46.185279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-935d69ad-ad2a-4294-aa95-676995fc4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:46.188416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32aa7df179d34c31ada062d7406a908a', 'request_id': 'req-b226af34-bf71-49fb-9d28-2bcb42de891f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.196174 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32aa7df179d34c31ada062d7406a908a', 'request_id': 'req-b226af34-bf71-49fb-9d28-2bcb42de891f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.208077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] The token cache is being invalidate because project 32aa7df179d34c31ada062d7406a908a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:46.208077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.208743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b226af34-bf71-49fb-9d28-2bcb42de891f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:46.210513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 920/1827] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:45 2022] DELETE /identity/v3/projects/32aa7df179d34c31ada062d7406a908a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:46.217388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f19f3b-99b2-4851-b553-1609661705a7 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.217685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f19f3b-99b2-4851-b553-1609661705a7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.217985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f19f3b-99b2-4851-b553-1609661705a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.237562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f4f19f3b-99b2-4851-b553-1609661705a7 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:46.238901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f4f19f3b-99b2-4851-b553-1609661705a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:46.255383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 908/1828] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:46.262035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d69ad-ad2a-4294-aa95-676995fc4ee2 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:46.263350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-935d69ad-ad2a-4294-aa95-676995fc4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:46.318800 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 921/1829] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:46.327196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40663ddd-b908-41e2-867f-4b149f87adb1 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.327754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40663ddd-b908-41e2-867f-4b149f87adb1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.328188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40663ddd-b908-41e2-867f-4b149f87adb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.337502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d69ad-ad2a-4294-aa95-676995fc4ee2 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:46.341546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433dd02-c8ef-4dcc-b8da-723043bc675e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:46.342311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433dd02-c8ef-4dcc-b8da-723043bc675e service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.342599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433dd02-c8ef-4dcc-b8da-723043bc675e service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.342876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433dd02-c8ef-4dcc-b8da-723043bc675e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.353395 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433dd02-c8ef-4dcc-b8da-723043bc675e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:46.354246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-40663ddd-b908-41e2-867f-4b149f87adb1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:46.355546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-40663ddd-b908-41e2-867f-4b149f87adb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:46.355925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433dd02-c8ef-4dcc-b8da-723043bc675e service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:46.364741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 922/1830] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:46.368876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40663ddd-b908-41e2-867f-4b149f87adb1 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:46.372651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 909/1831] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:46.379268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40663ddd-b908-41e2-867f-4b149f87adb1 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:46.384231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605c4ba-7ebd-4d53-9e85-e5520388e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:46.386303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605c4ba-7ebd-4d53-9e85-e5520388e3dc admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.386303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605c4ba-7ebd-4d53-9e85-e5520388e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.386303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605c4ba-7ebd-4d53-9e85-e5520388e3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.386303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605c4ba-7ebd-4d53-9e85-e5520388e3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:46.386631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605c4ba-7ebd-4d53-9e85-e5520388e3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:46.388211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605c4ba-7ebd-4d53-9e85-e5520388e3dc admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:46.401011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 923/1832] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:51:46.405236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433dd02-c8ef-4dcc-b8da-723043bc675e service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:46.415677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433dd02-c8ef-4dcc-b8da-723043bc675e service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:46.420902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1651007-29a1-446a-a64f-5fac40b0c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:46.421574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1651007-29a1-446a-a64f-5fac40b0c986 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.421858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1651007-29a1-446a-a64f-5fac40b0c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.422166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1651007-29a1-446a-a64f-5fac40b0c986 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.422864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1651007-29a1-446a-a64f-5fac40b0c986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:46.425426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1651007-29a1-446a-a64f-5fac40b0c986 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:46.545328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 910/1833] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:46 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:46.545907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605c4ba-7ebd-4d53-9e85-e5520388e3dc admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:46.557259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605c4ba-7ebd-4d53-9e85-e5520388e3dc admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:46.635477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103bd1-963f-425b-944a-1cbd929d1933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:46.636263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103bd1-963f-425b-944a-1cbd929d1933 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.636726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103bd1-963f-425b-944a-1cbd929d1933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.637161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103bd1-963f-425b-944a-1cbd929d1933 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.637859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103bd1-963f-425b-944a-1cbd929d1933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:46.640151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103bd1-963f-425b-944a-1cbd929d1933 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:46.642917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:46.787097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 924/1834] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:46 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:46.788607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1651007-29a1-446a-a64f-5fac40b0c986 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:46.799472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1651007-29a1-446a-a64f-5fac40b0c986 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:46.805060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90231-c296-46fa-b02a-3479c1bf76c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:46.805931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90231-c296-46fa-b02a-3479c1bf76c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.809394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90231-c296-46fa-b02a-3479c1bf76c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.809394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90231-c296-46fa-b02a-3479c1bf76c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.809394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90231-c296-46fa-b02a-3479c1bf76c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:46.809394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90231-c296-46fa-b02a-3479c1bf76c3 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:46.826684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 911/1835] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:46.831217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103bd1-963f-425b-944a-1cbd929d1933 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:46.844441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103bd1-963f-425b-944a-1cbd929d1933 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:46.852012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839edfd8-c8f4-43b3-98c2-0b9ab1d305ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:46.853387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839edfd8-c8f4-43b3-98c2-0b9ab1d305ef admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.853826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839edfd8-c8f4-43b3-98c2-0b9ab1d305ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.854144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839edfd8-c8f4-43b3-98c2-0b9ab1d305ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.854981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839edfd8-c8f4-43b3-98c2-0b9ab1d305ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:46.856923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839edfd8-c8f4-43b3-98c2-0b9ab1d305ef admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:46.870426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 925/1836] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:46.871808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90231-c296-46fa-b02a-3479c1bf76c3 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:46.883735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90231-c296-46fa-b02a-3479c1bf76c3 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:46.907267 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3523b8-34f1-4b26-ad9b-54c2d5206aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:46.908201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3523b8-34f1-4b26-ad9b-54c2d5206aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:46.908483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3523b8-34f1-4b26-ad9b-54c2d5206aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:46.910451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3523b8-34f1-4b26-ad9b-54c2d5206aaf admin admin] PATH_INFO: `/v3/projects/1c64a8490f7e41ef84b2c3e7646ba015/users/07ec4cee4eeb460c875464c5a2af2619/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:46.932940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3523b8-34f1-4b26-ad9b-54c2d5206aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c64a8490f7e41ef84b2c3e7646ba015, user_id=07ec4cee4eeb460c875464c5a2af2619, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:46.935971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3523b8-34f1-4b26-ad9b-54c2d5206aaf admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:47.048274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 912/1837] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:46 2022] PUT /identity/v3/projects/1c64a8490f7e41ef84b2c3e7646ba015/users/07ec4cee4eeb460c875464c5a2af2619/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:47.059581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f14f69-e6f1-4410-b583-d1d09246f85d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.060107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f14f69-e6f1-4410-b583-d1d09246f85d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.060517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f14f69-e6f1-4410-b583-d1d09246f85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.165448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a3f14f69-e6f1-4410-b583-d1d09246f85d None None] MFA Rules not processed for user `07ec4cee4eeb460c875464c5a2af2619`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:47.165448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a3f14f69-e6f1-4410-b583-d1d09246f85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:47.291536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3523b8-34f1-4b26-ad9b-54c2d5206aaf admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:47.291536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-5c3523b8-34f1-4b26-ad9b-54c2d5206aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:47.320485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 926/1838] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:47.325373 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f14f69-e6f1-4410-b583-d1d09246f85d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:47.370756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:47.415246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:47.446824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f14f69-e6f1-4410-b583-d1d09246f85d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:47.448470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3523b8-34f1-4b26-ad9b-54c2d5206aaf admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:47.455614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cff59-087b-44a1-8b47-d0dac6a2e5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:47.456355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cff59-087b-44a1-8b47-d0dac6a2e5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.456753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cff59-087b-44a1-8b47-d0dac6a2e5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.457490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cff59-087b-44a1-8b47-d0dac6a2e5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.458398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cff59-087b-44a1-8b47-d0dac6a2e5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:47.460817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cff59-087b-44a1-8b47-d0dac6a2e5f2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:47.470042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:47.470938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.471227 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.471507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] PATH_INFO: `/v3/projects/e05bf3b2806b47c4a4e0032a17a42936` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.473355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05bf3b2806b47c4a4e0032a17a42936)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:47.477840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:47.579491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 927/1839] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:47 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:47.580848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cff59-087b-44a1-8b47-d0dac6a2e5f2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:47.635868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05bf3b2806b47c4a4e0032a17a42936', 'request_id': 'req-25c19585-cafb-409f-8151-e37543474705'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.650830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05bf3b2806b47c4a4e0032a17a42936', 'request_id': 'req-25c19585-cafb-409f-8151-e37543474705'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.693972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cff59-087b-44a1-8b47-d0dac6a2e5f2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:47.721354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05bf3b2806b47c4a4e0032a17a42936', 'request_id': 'req-25c19585-cafb-409f-8151-e37543474705'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.742644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] The token cache is being invalidate because project e05bf3b2806b47c4a4e0032a17a42936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:47.743324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.744693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.747472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 913/1840] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:47 2022] DELETE /identity/v3/projects/e05bf3b2806b47c4a4e0032a17a42936 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:47.751664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:47.756503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:47.809817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c30316-aa0f-4419-9b0f-7d558dedd3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:47.810561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c30316-aa0f-4419-9b0f-7d558dedd3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.811941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c30316-aa0f-4419-9b0f-7d558dedd3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.814140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c30316-aa0f-4419-9b0f-7d558dedd3a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.814809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c30316-aa0f-4419-9b0f-7d558dedd3a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:47.823966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c30316-aa0f-4419-9b0f-7d558dedd3a3 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:47.910693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c19585-cafb-409f-8151-e37543474705 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:47.930462 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:47.931339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.931649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.933063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] PATH_INFO: `/v3/users/343dee1bf0414ca7bd70cb881646e59d` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.934758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=343dee1bf0414ca7bd70cb881646e59d)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:47.936695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:47.941032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 928/1841] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:47 2022] POST /identity/v3/users => generated 295 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:47.942419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c30316-aa0f-4419-9b0f-7d558dedd3a3 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:47.944529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a8c30316-aa0f-4419-9b0f-7d558dedd3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:47.960740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c30316-aa0f-4419-9b0f-7d558dedd3a3 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:47.967527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c55ef-18ff-43e5-9a59-becc5768fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:47.968272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c55ef-18ff-43e5-9a59-becc5768fc55 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.968566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c55ef-18ff-43e5-9a59-becc5768fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.968845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c55ef-18ff-43e5-9a59-becc5768fc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.969594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c55ef-18ff-43e5-9a59-becc5768fc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:47.971936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c55ef-18ff-43e5-9a59-becc5768fc55 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.002929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 929/1842] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:48.007413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c55ef-18ff-43e5-9a59-becc5768fc55 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.037856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c55ef-18ff-43e5-9a59-becc5768fc55 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.050617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e334452-4b85-4392-b87a-9812de70d04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.051556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334452-4b85-4392-b87a-9812de70d04d admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.051851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334452-4b85-4392-b87a-9812de70d04d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.052127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334452-4b85-4392-b87a-9812de70d04d admin admin] PATH_INFO: `/v3/projects/adbacb22c1ff45e1886693d5b9a0ed6f/users/29e983f30c794f1184e646d5a15f557d/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.088189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e334452-4b85-4392-b87a-9812de70d04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbacb22c1ff45e1886693d5b9a0ed6f, user_id=29e983f30c794f1184e646d5a15f557d, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.091621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e334452-4b85-4392-b87a-9812de70d04d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.239445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343dee1bf0414ca7bd70cb881646e59d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.285213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 930/1843] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:48 2022] PUT /identity/v3/projects/adbacb22c1ff45e1886693d5b9a0ed6f/users/29e983f30c794f1184e646d5a15f557d/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:48.286121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e334452-4b85-4392-b87a-9812de70d04d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.331899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343dee1bf0414ca7bd70cb881646e59d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.332620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343dee1bf0414ca7bd70cb881646e59d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.354573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343dee1bf0414ca7bd70cb881646e59d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.355324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343dee1bf0414ca7bd70cb881646e59d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.380798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 914/1844] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:47 2022] DELETE /identity/v3/users/343dee1bf0414ca7bd70cb881646e59d => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:48.413146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e334452-4b85-4392-b87a-9812de70d04d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.490967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e3d87-5f57-495f-a125-2acf1cb3a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.491667 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e3d87-5f57-495f-a125-2acf1cb3a4de admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.491958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e3d87-5f57-495f-a125-2acf1cb3a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.492242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e3d87-5f57-495f-a125-2acf1cb3a4de admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.493137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e3d87-5f57-495f-a125-2acf1cb3a4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.494823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e3d87-5f57-495f-a125-2acf1cb3a4de admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.515265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:48.529706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 931/1845] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:48.531581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.533423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:48.549399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd457-387a-43ec-9de7-c0a915881bee admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.556337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21253d65-8bbf-4370-97d5-97362ca439bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.564052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21253d65-8bbf-4370-97d5-97362ca439bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.564052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21253d65-8bbf-4370-97d5-97362ca439bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.564052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21253d65-8bbf-4370-97d5-97362ca439bd admin admin] PATH_INFO: `/v3/projects/adbacb22c1ff45e1886693d5b9a0ed6f/users/29e983f30c794f1184e646d5a15f557d/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.564052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21253d65-8bbf-4370-97d5-97362ca439bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbacb22c1ff45e1886693d5b9a0ed6f, user_id=29e983f30c794f1184e646d5a15f557d, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.564997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21253d65-8bbf-4370-97d5-97362ca439bd admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.590847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 915/1846] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:48 2022] PUT /identity/v3/projects/adbacb22c1ff45e1886693d5b9a0ed6f/users/29e983f30c794f1184e646d5a15f557d/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:48.597014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61af60-c0ca-4e0e-9e90-102eaca5321d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.597014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61af60-c0ca-4e0e-9e90-102eaca5321d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.597014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61af60-c0ca-4e0e-9e90-102eaca5321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.639025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-bb61af60-c0ca-4e0e-9e90-102eaca5321d None None] MFA Rules not processed for user `29e983f30c794f1184e646d5a15f557d`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:48.640803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bb61af60-c0ca-4e0e-9e90-102eaca5321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:48.781317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 932/1847] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:48.790493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21253d65-8bbf-4370-97d5-97362ca439bd admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.792917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-21253d65-8bbf-4370-97d5-97362ca439bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:48.932277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21253d65-8bbf-4370-97d5-97362ca439bd admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.937418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.938179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.938729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.938987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.941357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:49.033827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.035516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.050089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 916/1848] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:49.131997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:49.578660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61af60-c0ca-4e0e-9e90-102eaca5321d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.583483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bb61af60-c0ca-4e0e-9e90-102eaca5321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:49.697369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.699117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:49.711872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61af60-c0ca-4e0e-9e90-102eaca5321d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.718517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.719647 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.720104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.720692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] PATH_INFO: `/v3/projects/ebc58bc6083348d4900eeb8d791a04d6` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.722225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc58bc6083348d4900eeb8d791a04d6)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.725257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.726534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33066bf8-e2a0-4752-8081-1b43e8ac9af1 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.737217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.738534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.739089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.740228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] PATH_INFO: `/v3/users/21ca820be67c449494aa137bfb8b4a07` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.750507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ca820be67c449494aa137bfb8b4a07)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.750507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.880633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:49.917472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc58bc6083348d4900eeb8d791a04d6', 'request_id': 'req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.006815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc58bc6083348d4900eeb8d791a04d6', 'request_id': 'req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.018820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc58bc6083348d4900eeb8d791a04d6', 'request_id': 'req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.039113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] The token cache is being invalidate because project ebc58bc6083348d4900eeb8d791a04d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:50.039478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.041035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d5e80a82-3d50-42b4-8265-2f6515f9cb9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.043143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ca820be67c449494aa137bfb8b4a07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.043937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 933/1849] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:49 2022] DELETE /identity/v3/projects/ebc58bc6083348d4900eeb8d791a04d6 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:50.048690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b74dc3-a185-435e-a977-65829b2a3ccc None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:50.048870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b74dc3-a185-435e-a977-65829b2a3ccc None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:50.049204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b74dc3-a185-435e-a977-65829b2a3ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:50.086210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-05b74dc3-a185-435e-a977-65829b2a3ccc None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:50.087445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-05b74dc3-a185-435e-a977-65829b2a3ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:50.154859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ca820be67c449494aa137bfb8b4a07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.155781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ca820be67c449494aa137bfb8b4a07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.189135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ca820be67c449494aa137bfb8b4a07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.189971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-fb71aba7-0fef-4bb1-a633-b8ff03cc4718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ca820be67c449494aa137bfb8b4a07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:50.203551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 934/1850] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:50.210017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d4e07-9b4f-4a5c-8578-f83565951946 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:50.210557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d4e07-9b4f-4a5c-8578-f83565951946 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:50.211058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d4e07-9b4f-4a5c-8578-f83565951946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:50.225995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 917/1851] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:49 2022] DELETE /identity/v3/users/21ca820be67c449494aa137bfb8b4a07 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:50.229184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20830e3-7d74-473a-ad12-f5e820d2f0c6 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:50.229485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20830e3-7d74-473a-ad12-f5e820d2f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:50.229771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20830e3-7d74-473a-ad12-f5e820d2f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:50.249903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1f4d4e07-9b4f-4a5c-8578-f83565951946 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:50.251381 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1f4d4e07-9b4f-4a5c-8578-f83565951946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:50.267553 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e20830e3-7d74-473a-ad12-f5e820d2f0c6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:50.268848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e20830e3-7d74-473a-ad12-f5e820d2f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:50.343313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 918/1852] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:50.359753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20830e3-7d74-473a-ad12-f5e820d2f0c6 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:50.361250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e20830e3-7d74-473a-ad12-f5e820d2f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:50.409118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 935/1853] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:50.410980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef79cb-73de-4e87-a94c-d11b88ba7c70 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:50.411276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef79cb-73de-4e87-a94c-d11b88ba7c70 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:50.411563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef79cb-73de-4e87-a94c-d11b88ba7c70 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:50.413474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 936/1854] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:51:50.414408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef79cb-73de-4e87-a94c-d11b88ba7c70 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:50.446664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef79cb-73de-4e87-a94c-d11b88ba7c70 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:50.457788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20830e3-7d74-473a-ad12-f5e820d2f0c6 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:50.461384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce8b01-9f69-45ab-951d-af6a83d3a5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:50.462127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8b01-9f69-45ab-951d-af6a83d3a5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:50.462439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8b01-9f69-45ab-951d-af6a83d3a5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:50.462770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8b01-9f69-45ab-951d-af6a83d3a5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:50.463356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ce72-ea01-406e-a3c3-c63a26697305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:50.463810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce8b01-9f69-45ab-951d-af6a83d3a5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:50.463922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce8b01-9f69-45ab-951d-af6a83d3a5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:50.464082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ce72-ea01-406e-a3c3-c63a26697305 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:50.464583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ce72-ea01-406e-a3c3-c63a26697305 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:50.464875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ce72-ea01-406e-a3c3-c63a26697305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:50.467936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce8b01-9f69-45ab-951d-af6a83d3a5e9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:50.479260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9ce72-ea01-406e-a3c3-c63a26697305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:50.480967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9ce72-ea01-406e-a3c3-c63a26697305 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:50.495163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 937/1855] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:50.496493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5f9f0-964a-402d-93aa-53cc4730d1c2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:50.504300 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5f9f0-964a-402d-93aa-53cc4730d1c2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:50.505657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5f9f0-964a-402d-93aa-53cc4730d1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:50.522005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 919/1856] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:50.523147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ce72-ea01-406e-a3c3-c63a26697305 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:50.543080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4ac5f9f0-964a-402d-93aa-53cc4730d1c2 None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:50.544474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4ac5f9f0-964a-402d-93aa-53cc4730d1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:50.546085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ce72-ea01-406e-a3c3-c63a26697305 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:50.558365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ccb23-60a6-433f-b9ed-2eec1cbad4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:50.559294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ccb23-60a6-433f-b9ed-2eec1cbad4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:50.561105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ccb23-60a6-433f-b9ed-2eec1cbad4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:50.561600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ccb23-60a6-433f-b9ed-2eec1cbad4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:50.562696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ccb23-60a6-433f-b9ed-2eec1cbad4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:50.567239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ccb23-60a6-433f-b9ed-2eec1cbad4d0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:50.652381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:50.688741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 920/1857] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:50 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:50.693874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ccb23-60a6-433f-b9ed-2eec1cbad4d0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:50.721721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 938/1858] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:51:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:50.806400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ccb23-60a6-433f-b9ed-2eec1cbad4d0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:50.818629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ac9f9-5845-4997-b487-29717ed70d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:50.819590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ac9f9-5845-4997-b487-29717ed70d60 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:50.820031 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ac9f9-5845-4997-b487-29717ed70d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:50.823036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ac9f9-5845-4997-b487-29717ed70d60 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:50.823036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ac9f9-5845-4997-b487-29717ed70d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:50.824257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ac9f9-5845-4997-b487-29717ed70d60 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:50.956147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 921/1859] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:50 2022] POST /identity/v3/users => generated 295 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:50.959972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5f9f0-964a-402d-93aa-53cc4730d1c2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:50.997196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ac9f9-5845-4997-b487-29717ed70d60 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:50.999616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-560ac9f9-5845-4997-b487-29717ed70d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:51.004705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5f9f0-964a-402d-93aa-53cc4730d1c2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:51.021333 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cc8ab-e69a-4096-ad61-54017191198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:51.022089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc8ab-e69a-4096-ad61-54017191198a admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:51.022386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc8ab-e69a-4096-ad61-54017191198a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:51.022674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc8ab-e69a-4096-ad61-54017191198a admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:51.023427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cc8ab-e69a-4096-ad61-54017191198a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:51.025377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cc8ab-e69a-4096-ad61-54017191198a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:51.045403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 939/1860] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:51.049139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cc8ab-e69a-4096-ad61-54017191198a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:51.070751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cc8ab-e69a-4096-ad61-54017191198a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:51.076730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9400e-9413-44ef-a4da-cff72e061a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:51.077259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9400e-9413-44ef-a4da-cff72e061a63 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:51.077556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9400e-9413-44ef-a4da-cff72e061a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:51.077835 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9400e-9413-44ef-a4da-cff72e061a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:51.079039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9400e-9413-44ef-a4da-cff72e061a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:51.080518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9400e-9413-44ef-a4da-cff72e061a63 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:51.094742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 940/1861] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:51.095896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9400e-9413-44ef-a4da-cff72e061a63 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:51.098274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-66d9400e-9413-44ef-a4da-cff72e061a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:51.119072 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ac9f9-5845-4997-b487-29717ed70d60 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:51.127203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111cd34-aa39-4e4c-b7ae-aa1155cc10ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:51.127982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111cd34-aa39-4e4c-b7ae-aa1155cc10ff service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:51.128294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111cd34-aa39-4e4c-b7ae-aa1155cc10ff service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:51.128644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111cd34-aa39-4e4c-b7ae-aa1155cc10ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:51.142748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111cd34-aa39-4e4c-b7ae-aa1155cc10ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:51.146139 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111cd34-aa39-4e4c-b7ae-aa1155cc10ff service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:51.167350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 922/1862] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:51.168791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111cd34-aa39-4e4c-b7ae-aa1155cc10ff service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:51.179307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9400e-9413-44ef-a4da-cff72e061a63 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:51.183193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111cd34-aa39-4e4c-b7ae-aa1155cc10ff service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:51.183731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3364d-0b03-47ca-97c1-56dcbbc6a2fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:51.184820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3364d-0b03-47ca-97c1-56dcbbc6a2fe service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:51.190461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3364d-0b03-47ca-97c1-56dcbbc6a2fe service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:51.190906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef4a84-b8f2-46f2-9db9-9110f57a4aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:51.190906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef4a84-b8f2-46f2-9db9-9110f57a4aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:51.191173 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef4a84-b8f2-46f2-9db9-9110f57a4aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:51.191571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef4a84-b8f2-46f2-9db9-9110f57a4aa0 admin admin] PATH_INFO: `/v3/projects/487bef6e1f194008b57c135acd1e4e03/users/1d812bab83ca4b4dbff548a31ad3fd76/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:51.196980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3364d-0b03-47ca-97c1-56dcbbc6a2fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:51.199226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-acc3364d-0b03-47ca-97c1-56dcbbc6a2fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:51.241719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef4a84-b8f2-46f2-9db9-9110f57a4aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487bef6e1f194008b57c135acd1e4e03, user_id=1d812bab83ca4b4dbff548a31ad3fd76, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:51.249978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef4a84-b8f2-46f2-9db9-9110f57a4aa0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:51.329400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3364d-0b03-47ca-97c1-56dcbbc6a2fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:51.332039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3364d-0b03-47ca-97c1-56dcbbc6a2fe service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:51.349550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 941/1863] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:51.358786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 923/1864] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:51 2022] PUT /identity/v3/projects/487bef6e1f194008b57c135acd1e4e03/users/1d812bab83ca4b4dbff548a31ad3fd76/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:51.371606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40a0fa-400b-407f-a346-b3d67630b502 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:51.372210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40a0fa-400b-407f-a346-b3d67630b502 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:51.372812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40a0fa-400b-407f-a346-b3d67630b502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:51.421578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-6f40a0fa-400b-407f-a346-b3d67630b502 None None] MFA Rules not processed for user `1d812bab83ca4b4dbff548a31ad3fd76`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:51.421757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6f40a0fa-400b-407f-a346-b3d67630b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:51.598290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 942/1865] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:51.601296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef4a84-b8f2-46f2-9db9-9110f57a4aa0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:51.670840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40a0fa-400b-407f-a346-b3d67630b502 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:51.674943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6f40a0fa-400b-407f-a346-b3d67630b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:51.722942 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef4a84-b8f2-46f2-9db9-9110f57a4aa0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:51.730478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb98fde-5a1b-4e74-8bb4-b90f9ad046cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:51.731717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb98fde-5a1b-4e74-8bb4-b90f9ad046cf admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:51.732196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb98fde-5a1b-4e74-8bb4-b90f9ad046cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:51.732670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb98fde-5a1b-4e74-8bb4-b90f9ad046cf admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:51.733751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb98fde-5a1b-4e74-8bb4-b90f9ad046cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:51.735997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb98fde-5a1b-4e74-8bb4-b90f9ad046cf admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:51.828079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40a0fa-400b-407f-a346-b3d67630b502 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:51.835316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:51.836928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:51.837515 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:51.837965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] PATH_INFO: `/v3/projects/f45f5503bd1f436783f170843efc26c4` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:51.839857 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45f5503bd1f436783f170843efc26c4)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:51.842627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:51.867405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 924/1866] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:51 2022] POST /identity/v3/projects => generated 389 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:51.870954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb98fde-5a1b-4e74-8bb4-b90f9ad046cf admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:51.988512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb98fde-5a1b-4e74-8bb4-b90f9ad046cf admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:52.012383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9018f5-d00b-4296-8d71-d5025e46270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:52.012383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9018f5-d00b-4296-8d71-d5025e46270b admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.012383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9018f5-d00b-4296-8d71-d5025e46270b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.012383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9018f5-d00b-4296-8d71-d5025e46270b admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.014579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9018f5-d00b-4296-8d71-d5025e46270b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:52.019007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9018f5-d00b-4296-8d71-d5025e46270b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:52.067191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45f5503bd1f436783f170843efc26c4', 'request_id': 'req-3f1652de-3e9b-458d-ad56-40ebe91d1350'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.155229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 925/1867] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:51 2022] POST /identity/v3/users => generated 301 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:52.159237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9018f5-d00b-4296-8d71-d5025e46270b admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:52.174135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9018f5-d00b-4296-8d71-d5025e46270b admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:52.177553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45f5503bd1f436783f170843efc26c4', 'request_id': 'req-3f1652de-3e9b-458d-ad56-40ebe91d1350'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.189695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45f5503bd1f436783f170843efc26c4', 'request_id': 'req-3f1652de-3e9b-458d-ad56-40ebe91d1350'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.213084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] The token cache is being invalidate because project f45f5503bd1f436783f170843efc26c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:52.215103 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.215103 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.219346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 943/1868] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:51 2022] DELETE /identity/v3/projects/f45f5503bd1f436783f170843efc26c4 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:52.220378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:52.221275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:52.248386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae44c6-5770-48c5-88a8-de968df3d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:52.249118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae44c6-5770-48c5-88a8-de968df3d7dc admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.249794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae44c6-5770-48c5-88a8-de968df3d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.250197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae44c6-5770-48c5-88a8-de968df3d7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.251421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae44c6-5770-48c5-88a8-de968df3d7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:52.253419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae44c6-5770-48c5-88a8-de968df3d7dc admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:52.266844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 926/1869] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:52.271076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae44c6-5770-48c5-88a8-de968df3d7dc admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:52.272875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8bae44c6-5770-48c5-88a8-de968df3d7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:52.285593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae44c6-5770-48c5-88a8-de968df3d7dc admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:52.292081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92c1eb-11f9-4bbf-b0c4-03f9b8cbe84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:52.293171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92c1eb-11f9-4bbf-b0c4-03f9b8cbe84f admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.293440 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92c1eb-11f9-4bbf-b0c4-03f9b8cbe84f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.293726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92c1eb-11f9-4bbf-b0c4-03f9b8cbe84f admin admin] PATH_INFO: `/v3/projects/146c503b386f4cd7b0f0bcdd047eeca7/users/435096028a734a9b859a68be201416c9/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.307422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1652de-3e9b-458d-ad56-40ebe91d1350 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:52.312374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:52.313079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92c1eb-11f9-4bbf-b0c4-03f9b8cbe84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=146c503b386f4cd7b0f0bcdd047eeca7, user_id=435096028a734a9b859a68be201416c9, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:52.313324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.313615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.313889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] PATH_INFO: `/v3/users/98657c85be744b1f87f6af32d3358bbe` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.318992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98657c85be744b1f87f6af32d3358bbe)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:52.319159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92c1eb-11f9-4bbf-b0c4-03f9b8cbe84f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:52.319277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:52.422938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 927/1870] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:52 2022] PUT /identity/v3/projects/146c503b386f4cd7b0f0bcdd047eeca7/users/435096028a734a9b859a68be201416c9/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:52.426881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92c1eb-11f9-4bbf-b0c4-03f9b8cbe84f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:52.517577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92c1eb-11f9-4bbf-b0c4-03f9b8cbe84f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:52.524513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e40f7f-e44e-4775-bdf6-49c98a940d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:52.525302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e40f7f-e44e-4775-bdf6-49c98a940d90 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.525302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e40f7f-e44e-4775-bdf6-49c98a940d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.525532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e40f7f-e44e-4775-bdf6-49c98a940d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.526443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e40f7f-e44e-4775-bdf6-49c98a940d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:52.528088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e40f7f-e44e-4775-bdf6-49c98a940d90 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:52.540458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 928/1871] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:51:52.545167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e40f7f-e44e-4775-bdf6-49c98a940d90 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:52.561110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e40f7f-e44e-4775-bdf6-49c98a940d90 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:52.568583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6219b-533b-480f-9408-cb686a4a6b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:52.569540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6219b-533b-480f-9408-cb686a4a6b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.569838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6219b-533b-480f-9408-cb686a4a6b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.570156 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6219b-533b-480f-9408-cb686a4a6b2f admin admin] PATH_INFO: `/v3/projects/146c503b386f4cd7b0f0bcdd047eeca7/users/435096028a734a9b859a68be201416c9/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.572203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6219b-533b-480f-9408-cb686a4a6b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=146c503b386f4cd7b0f0bcdd047eeca7, user_id=435096028a734a9b859a68be201416c9, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:52.576840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6219b-533b-480f-9408-cb686a4a6b2f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:52.581154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98657c85be744b1f87f6af32d3358bbe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.594769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 929/1872] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:52 2022] PUT /identity/v3/projects/146c503b386f4cd7b0f0bcdd047eeca7/users/435096028a734a9b859a68be201416c9/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:52.605665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79154-f6f3-4f93-83c2-f1009392230a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.606238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79154-f6f3-4f93-83c2-f1009392230a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.606526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79154-f6f3-4f93-83c2-f1009392230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.645991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1bc79154-f6f3-4f93-83c2-f1009392230a None None] MFA Rules not processed for user `435096028a734a9b859a68be201416c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:52.647527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1bc79154-f6f3-4f93-83c2-f1009392230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:52.663458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98657c85be744b1f87f6af32d3358bbe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.678453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98657c85be744b1f87f6af32d3358bbe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.679444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98657c85be744b1f87f6af32d3358bbe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.687034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98657c85be744b1f87f6af32d3358bbe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.695840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 944/1873] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:52 2022] DELETE /identity/v3/users/98657c85be744b1f87f6af32d3358bbe => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:52.700477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:52.738834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 930/1874] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:52.753112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:52.755807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:52.855551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924162c-384d-410c-a261-bd4403000fd4 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:52.862888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1c422-99e6-40ec-9ef3-e554e6dd0772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:52.863571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1c422-99e6-40ec-9ef3-e554e6dd0772 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.863907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1c422-99e6-40ec-9ef3-e554e6dd0772 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.864177 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1c422-99e6-40ec-9ef3-e554e6dd0772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:53.008107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1c422-99e6-40ec-9ef3-e554e6dd0772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:53.011263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1c422-99e6-40ec-9ef3-e554e6dd0772 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:53.040264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 945/1875] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:53.224000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc79154-f6f3-4f93-83c2-f1009392230a None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:53.226103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1bc79154-f6f3-4f93-83c2-f1009392230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:53.308735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc79154-f6f3-4f93-83c2-f1009392230a None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:53.385852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:53.386798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:53.387089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:53.387369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] PATH_INFO: `/v3/users/1d812bab83ca4b4dbff548a31ad3fd76` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:53.389180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d812bab83ca4b4dbff548a31ad3fd76)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:53.391206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:53.657596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d812bab83ca4b4dbff548a31ad3fd76'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.777565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d812bab83ca4b4dbff548a31ad3fd76'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.778476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d812bab83ca4b4dbff548a31ad3fd76'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.794576 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d812bab83ca4b4dbff548a31ad3fd76'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.795325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d812bab83ca4b4dbff548a31ad3fd76'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.810156 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 931/1876] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:53 2022] DELETE /identity/v3/users/1d812bab83ca4b4dbff548a31ad3fd76 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:53.816606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd615f40-8040-49f6-a141-a919f11292ea None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:53.817735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd615f40-8040-49f6-a141-a919f11292ea None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:53.818042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd615f40-8040-49f6-a141-a919f11292ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:53.837197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:53.840065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:53.858638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-bd615f40-8040-49f6-a141-a919f11292ea None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:53.860900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bd615f40-8040-49f6-a141-a919f11292ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:53.966315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 946/1877] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:53.979313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd615f40-8040-49f6-a141-a919f11292ea None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:53.980721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bd615f40-8040-49f6-a141-a919f11292ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:53.988576 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf265e-deec-4c00-9bef-a4ec50178569 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:53.994455 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:53.995578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:53.995928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:53.996260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] PATH_INFO: `/v3/projects/96f3be11705b4567ad4378b4903f66f0` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:53.997529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f3be11705b4567ad4378b4903f66f0)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:53.999783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.058459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd615f40-8040-49f6-a141-a919f11292ea None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.062224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435bb04-b11d-4c69-a473-3b99a5daae61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.062933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bb04-b11d-4c69-a473-3b99a5daae61 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.063224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bb04-b11d-4c69-a473-3b99a5daae61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.063505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bb04-b11d-4c69-a473-3b99a5daae61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.073617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435bb04-b11d-4c69-a473-3b99a5daae61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.075124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435bb04-b11d-4c69-a473-3b99a5daae61 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.085408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 947/1878] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:51:54.147275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f3be11705b4567ad4378b4903f66f0', 'request_id': 'req-51fbb4aa-ff98-4f54-90d1-413b0d760edb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:54.153333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f3be11705b4567ad4378b4903f66f0', 'request_id': 'req-51fbb4aa-ff98-4f54-90d1-413b0d760edb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:54.327730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f3be11705b4567ad4378b4903f66f0', 'request_id': 'req-51fbb4aa-ff98-4f54-90d1-413b0d760edb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:54.343229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] The token cache is being invalidate because project 96f3be11705b4567ad4378b4903f66f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:54.344984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:54.345733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-51fbb4aa-ff98-4f54-90d1-413b0d760edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:54.350948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 932/1879] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:53 2022] DELETE /identity/v3/projects/96f3be11705b4567ad4378b4903f66f0 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:54.354220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193576c-5412-44f0-ba13-f10da3be8a60 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.355239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193576c-5412-44f0-ba13-f10da3be8a60 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.355612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193576c-5412-44f0-ba13-f10da3be8a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.378605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-5193576c-5412-44f0-ba13-f10da3be8a60 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:54.381830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5193576c-5412-44f0-ba13-f10da3be8a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:54.454526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 948/1880] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:54.463304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432ad62-a6d2-46d6-a219-b8d1861566c5 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.463595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432ad62-a6d2-46d6-a219-b8d1861566c5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.463877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432ad62-a6d2-46d6-a219-b8d1861566c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.501364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6432ad62-a6d2-46d6-a219-b8d1861566c5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:54.502864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6432ad62-a6d2-46d6-a219-b8d1861566c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:54.512461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 933/1881] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:54.516700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193576c-5412-44f0-ba13-f10da3be8a60 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.526236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:54.527238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193576c-5412-44f0-ba13-f10da3be8a60 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.531964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47343002-6990-4bed-8b02-94cdb1a486d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.532664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47343002-6990-4bed-8b02-94cdb1a486d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.532952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47343002-6990-4bed-8b02-94cdb1a486d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.533232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47343002-6990-4bed-8b02-94cdb1a486d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.537649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47343002-6990-4bed-8b02-94cdb1a486d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:54.537649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47343002-6990-4bed-8b02-94cdb1a486d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.537649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47343002-6990-4bed-8b02-94cdb1a486d5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.548377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 949/1882] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:54.552940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432ad62-a6d2-46d6-a219-b8d1861566c5 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.562395 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432ad62-a6d2-46d6-a219-b8d1861566c5 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.567833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b59a-b42e-45f1-b740-135718b078fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.568495 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b59a-b42e-45f1-b740-135718b078fc admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.568777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b59a-b42e-45f1-b740-135718b078fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.569172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b59a-b42e-45f1-b740-135718b078fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.569900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1b59a-b42e-45f1-b740-135718b078fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.571782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1b59a-b42e-45f1-b740-135718b078fc admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.650947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 934/1883] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:54.655472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47343002-6990-4bed-8b02-94cdb1a486d5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.668023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47343002-6990-4bed-8b02-94cdb1a486d5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.722372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b59a-b42e-45f1-b740-135718b078fc admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.724473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-54f1b59a-b42e-45f1-b740-135718b078fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:54.793432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514d8cb-96de-4cd6-896a-3985e795dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.794489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514d8cb-96de-4cd6-896a-3985e795dd6f admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.794880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514d8cb-96de-4cd6-896a-3985e795dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.795251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514d8cb-96de-4cd6-896a-3985e795dd6f admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.796064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514d8cb-96de-4cd6-896a-3985e795dd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.798304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514d8cb-96de-4cd6-896a-3985e795dd6f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.857646 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b59a-b42e-45f1-b740-135718b078fc admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.863017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.864614 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.864894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.865165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] PATH_INFO: `/v3/projects/487bef6e1f194008b57c135acd1e4e03` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.866402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487bef6e1f194008b57c135acd1e4e03)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.868337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.898386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 950/1884] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:54.902418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514d8cb-96de-4cd6-896a-3985e795dd6f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.920271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514d8cb-96de-4cd6-896a-3985e795dd6f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.925096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ccb13-a82e-4160-825c-38565b0431f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.926809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ccb13-a82e-4160-825c-38565b0431f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.926809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ccb13-a82e-4160-825c-38565b0431f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.927106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ccb13-a82e-4160-825c-38565b0431f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.927839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ccb13-a82e-4160-825c-38565b0431f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.929538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ccb13-a82e-4160-825c-38565b0431f9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.939637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 951/1885] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:51:54.944866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ccb13-a82e-4160-825c-38565b0431f9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.954626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ccb13-a82e-4160-825c-38565b0431f9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.959774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d0fb9-d5ad-4ad4-9ffd-2fc4cbcfa914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.960619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d0fb9-d5ad-4ad4-9ffd-2fc4cbcfa914 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.960912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d0fb9-d5ad-4ad4-9ffd-2fc4cbcfa914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.961191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d0fb9-d5ad-4ad4-9ffd-2fc4cbcfa914 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.961913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d0fb9-d5ad-4ad4-9ffd-2fc4cbcfa914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.963671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d0fb9-d5ad-4ad4-9ffd-2fc4cbcfa914 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.981399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 952/1886] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:51:54.981573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487bef6e1f194008b57c135acd1e4e03', 'request_id': 'req-944e3134-11ba-43f0-9540-d2862ecbd814'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:54.985166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d0fb9-d5ad-4ad4-9ffd-2fc4cbcfa914 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.986804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487bef6e1f194008b57c135acd1e4e03', 'request_id': 'req-944e3134-11ba-43f0-9540-d2862ecbd814'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:54.998691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d0fb9-d5ad-4ad4-9ffd-2fc4cbcfa914 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.072960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b4b9a-840e-4349-83b1-9356db91cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.074024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b4b9a-840e-4349-83b1-9356db91cef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.074529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b4b9a-840e-4349-83b1-9356db91cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.074764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b4b9a-840e-4349-83b1-9356db91cef9 admin admin] PATH_INFO: `/v3/projects/857e69f9d6f34e55acb1900a71f4b17a/users/4328d378a9cc411f956b990feb3a4246/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.090405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b4b9a-840e-4349-83b1-9356db91cef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=857e69f9d6f34e55acb1900a71f4b17a, user_id=4328d378a9cc411f956b990feb3a4246, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.093103 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b4b9a-840e-4349-83b1-9356db91cef9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.103979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487bef6e1f194008b57c135acd1e4e03', 'request_id': 'req-944e3134-11ba-43f0-9540-d2862ecbd814'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:55.118022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] The token cache is being invalidate because project 487bef6e1f194008b57c135acd1e4e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:55.118352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:55.119004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:55.120651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 935/1887] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:54 2022] DELETE /identity/v3/projects/487bef6e1f194008b57c135acd1e4e03 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:55.124833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.126506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:55.143202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3134-11ba-43f0-9540-d2862ecbd814 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.154095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.155277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.155634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.156456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] PATH_INFO: `/v3/users/435096028a734a9b859a68be201416c9` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.157984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435096028a734a9b859a68be201416c9)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.160188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.172391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 953/1888] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:54 2022] PUT /identity/v3/projects/857e69f9d6f34e55acb1900a71f4b17a/users/4328d378a9cc411f956b990feb3a4246/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:55.183791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3362ea-02a7-477e-907e-0db9a2efa4f3 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.184085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3362ea-02a7-477e-907e-0db9a2efa4f3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.184366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3362ea-02a7-477e-907e-0db9a2efa4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.216322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3d3362ea-02a7-477e-907e-0db9a2efa4f3 None None] MFA Rules not processed for user `4328d378a9cc411f956b990feb3a4246`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:55.217574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3d3362ea-02a7-477e-907e-0db9a2efa4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:55.283068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 954/1889] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:55.288026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3362ea-02a7-477e-907e-0db9a2efa4f3 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.289500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3d3362ea-02a7-477e-907e-0db9a2efa4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:55.356945 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3362ea-02a7-477e-907e-0db9a2efa4f3 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.361624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc46dd-1f85-4e5d-a3bb-576e1005e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.362322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc46dd-1f85-4e5d-a3bb-576e1005e272 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.362610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc46dd-1f85-4e5d-a3bb-576e1005e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.362900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc46dd-1f85-4e5d-a3bb-576e1005e272 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.363597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc46dd-1f85-4e5d-a3bb-576e1005e272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.365523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc46dd-1f85-4e5d-a3bb-576e1005e272 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.391347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435096028a734a9b859a68be201416c9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:55.472256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 955/1890] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:55 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:55.476721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc46dd-1f85-4e5d-a3bb-576e1005e272 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.491365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435096028a734a9b859a68be201416c9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:55.492559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435096028a734a9b859a68be201416c9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:55.504914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435096028a734a9b859a68be201416c9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:55.505549 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435096028a734a9b859a68be201416c9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:55.517705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 936/1891] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:55 2022] DELETE /identity/v3/users/435096028a734a9b859a68be201416c9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:55.538488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc46dd-1f85-4e5d-a3bb-576e1005e272 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.601618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ec09-bed3-42ac-91bf-fcb843f46728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.602445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ec09-bed3-42ac-91bf-fcb843f46728 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.602812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ec09-bed3-42ac-91bf-fcb843f46728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.603159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ec09-bed3-42ac-91bf-fcb843f46728 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.603965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956ec09-bed3-42ac-91bf-fcb843f46728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.606391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956ec09-bed3-42ac-91bf-fcb843f46728 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.692987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 956/1892] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:55 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:55.696891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.699005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:55.713922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4874f-96ae-457d-90e8-fc4a4b009ca4 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.719002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c4764-9c69-4e21-ae7f-22a4af7e6910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.719825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4764-9c69-4e21-ae7f-22a4af7e6910 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.720208 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4764-9c69-4e21-ae7f-22a4af7e6910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.720585 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4764-9c69-4e21-ae7f-22a4af7e6910 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.721420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c4764-9c69-4e21-ae7f-22a4af7e6910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.723421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c4764-9c69-4e21-ae7f-22a4af7e6910 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.745791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 937/1893] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:51:55.747108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ec09-bed3-42ac-91bf-fcb843f46728 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.762777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ec09-bed3-42ac-91bf-fcb843f46728 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.769648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cab1cf-04d7-4baa-ae31-da6f07068594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.771889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cab1cf-04d7-4baa-ae31-da6f07068594 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.774085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cab1cf-04d7-4baa-ae31-da6f07068594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.774085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cab1cf-04d7-4baa-ae31-da6f07068594 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.774085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cab1cf-04d7-4baa-ae31-da6f07068594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.776220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cab1cf-04d7-4baa-ae31-da6f07068594 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.795250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 957/1894] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:55.799346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c4764-9c69-4e21-ae7f-22a4af7e6910 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.810793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c4764-9c69-4e21-ae7f-22a4af7e6910 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.816409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deffc62-a877-4236-bb77-ad4fd1feae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.817919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deffc62-a877-4236-bb77-ad4fd1feae9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.818311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deffc62-a877-4236-bb77-ad4fd1feae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.818666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deffc62-a877-4236-bb77-ad4fd1feae9c admin admin] PATH_INFO: `/v3/projects/22fa235aa8bd4c95be030e01e9e58c35/users/24e414c9d130496f9cc3f905cc860971/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.839892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deffc62-a877-4236-bb77-ad4fd1feae9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fa235aa8bd4c95be030e01e9e58c35, user_id=24e414c9d130496f9cc3f905cc860971, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.842636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deffc62-a877-4236-bb77-ad4fd1feae9c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.982990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 938/1895] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:55 2022] PUT /identity/v3/projects/22fa235aa8bd4c95be030e01e9e58c35/users/24e414c9d130496f9cc3f905cc860971/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:56.002829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e345f2-e2c1-41c5-9987-6f2ec584824d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.003332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e345f2-e2c1-41c5-9987-6f2ec584824d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.003332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e345f2-e2c1-41c5-9987-6f2ec584824d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.026422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deffc62-a877-4236-bb77-ad4fd1feae9c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.031111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9deffc62-a877-4236-bb77-ad4fd1feae9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:56.074485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a7e345f2-e2c1-41c5-9987-6f2ec584824d None None] MFA Rules not processed for user `24e414c9d130496f9cc3f905cc860971`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:56.076111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a7e345f2-e2c1-41c5-9987-6f2ec584824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:56.117137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deffc62-a877-4236-bb77-ad4fd1feae9c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:56.123840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:56.124877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.125165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.125446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] PATH_INFO: `/v3/projects/146c503b386f4cd7b0f0bcdd047eeca7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.130007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=146c503b386f4cd7b0f0bcdd047eeca7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:56.130007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.157471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 958/1896] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:56.161870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e345f2-e2c1-41c5-9987-6f2ec584824d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.163411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a7e345f2-e2c1-41c5-9987-6f2ec584824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:56.167701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:56.179092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e345f2-e2c1-41c5-9987-6f2ec584824d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:56.183706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:56.184569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.184853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.185129 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] PATH_INFO: `/v3/users/07ec4cee4eeb460c875464c5a2af2619` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.186374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ec4cee4eeb460c875464c5a2af2619)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:56.188297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.236597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '146c503b386f4cd7b0f0bcdd047eeca7', 'request_id': 'req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.243967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '146c503b386f4cd7b0f0bcdd047eeca7', 'request_id': 'req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.309066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '146c503b386f4cd7b0f0bcdd047eeca7', 'request_id': 'req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.326565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] The token cache is being invalidate because project 146c503b386f4cd7b0f0bcdd047eeca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:56.326565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.326565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.328592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 939/1897] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:56 2022] DELETE /identity/v3/projects/146c503b386f4cd7b0f0bcdd047eeca7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:56.329486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.330895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:56.407884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc5990-2fd5-4dc6-ad02-f6703c47c78a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:56.410276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ec4cee4eeb460c875464c5a2af2619'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.413243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c41a9-9872-442c-8e89-da054110c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:56.413917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c41a9-9872-442c-8e89-da054110c3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.414371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c41a9-9872-442c-8e89-da054110c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.414788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c41a9-9872-442c-8e89-da054110c3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.415597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c41a9-9872-442c-8e89-da054110c3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:56.417835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c41a9-9872-442c-8e89-da054110c3e5 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.525228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ec4cee4eeb460c875464c5a2af2619'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.532773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 940/1898] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:56 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:56.534193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3f32-76bf-4043-88b2-f93c5ea4583f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.534495 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3f32-76bf-4043-88b2-f93c5ea4583f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.534789 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3f32-76bf-4043-88b2-f93c5ea4583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.539867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ec4cee4eeb460c875464c5a2af2619'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.540676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ec4cee4eeb460c875464c5a2af2619'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.547643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ec4cee4eeb460c875464c5a2af2619'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:56.554000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-d1da3f32-76bf-4043-88b2-f93c5ea4583f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:56.557258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 959/1899] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:56 2022] DELETE /identity/v3/users/07ec4cee4eeb460c875464c5a2af2619 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:56.557258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.557442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d1da3f32-76bf-4043-88b2-f93c5ea4583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:56.558594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:56.615615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 941/1900] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:56.616887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeaf02-5502-401c-8816-f196c69fa348 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.617280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeaf02-5502-401c-8816-f196c69fa348 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.617665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeaf02-5502-401c-8816-f196c69fa348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.622202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0628e6d-841d-4100-9d36-e69ff4dbb136 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:56.628402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbcddf-ee37-4965-86e0-76378d7d9904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:56.629173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbcddf-ee37-4965-86e0-76378d7d9904 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.629548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbcddf-ee37-4965-86e0-76378d7d9904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.629842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbcddf-ee37-4965-86e0-76378d7d9904 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.630602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbcddf-ee37-4965-86e0-76378d7d9904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:56.632547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbcddf-ee37-4965-86e0-76378d7d9904 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.638338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3bbeaf02-5502-401c-8816-f196c69fa348 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:56.639467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3bbeaf02-5502-401c-8816-f196c69fa348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:56.647359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 942/1901] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:56.648652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12843a6-3f04-4423-99c9-37a0707d4d38 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.648945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12843a6-3f04-4423-99c9-37a0707d4d38 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.649227 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12843a6-3f04-4423-99c9-37a0707d4d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.667259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b12843a6-3f04-4423-99c9-37a0707d4d38 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:56.668433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b12843a6-3f04-4423-99c9-37a0707d4d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:56.676932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 943/1902] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:56.685239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12843a6-3f04-4423-99c9-37a0707d4d38 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.685239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b12843a6-3f04-4423-99c9-37a0707d4d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:56.744977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12843a6-3f04-4423-99c9-37a0707d4d38 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:56.745252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 960/1903] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:56 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:56.746200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbcddf-ee37-4965-86e0-76378d7d9904 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.750414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bec435-0442-42f7-9420-390e5b3b3b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:56.751389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bec435-0442-42f7-9420-390e5b3b3b42 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.751838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bec435-0442-42f7-9420-390e5b3b3b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.752152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bec435-0442-42f7-9420-390e5b3b3b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.758632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbcddf-ee37-4965-86e0-76378d7d9904 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:56.764384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed11354-af7a-4261-a3e2-c02aae7380ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:56.765171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed11354-af7a-4261-a3e2-c02aae7380ea admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.765532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed11354-af7a-4261-a3e2-c02aae7380ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.765880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed11354-af7a-4261-a3e2-c02aae7380ea admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.766742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed11354-af7a-4261-a3e2-c02aae7380ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:56.767122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed11354-af7a-4261-a3e2-c02aae7380ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:56.768999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed11354-af7a-4261-a3e2-c02aae7380ea admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.771642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bec435-0442-42f7-9420-390e5b3b3b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:56.773104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bec435-0442-42f7-9420-390e5b3b3b42 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.782648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 961/1904] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:56.783052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 944/1905] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:56.783475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed11354-af7a-4261-a3e2-c02aae7380ea admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.787292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bec435-0442-42f7-9420-390e5b3b3b42 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.795412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed11354-af7a-4261-a3e2-c02aae7380ea admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:56.797472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bec435-0442-42f7-9420-390e5b3b3b42 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:56.799969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5432b19-09d0-4592-ab67-816f6f947870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:56.800885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5432b19-09d0-4592-ab67-816f6f947870 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.801742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5432b19-09d0-4592-ab67-816f6f947870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.802129 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5432b19-09d0-4592-ab67-816f6f947870 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.802936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5432b19-09d0-4592-ab67-816f6f947870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:56.803371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a025ac-7f67-4756-b01d-dc9fb32be8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:56.804662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a025ac-7f67-4756-b01d-dc9fb32be8fe admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.804832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5432b19-09d0-4592-ab67-816f6f947870 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.805013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a025ac-7f67-4756-b01d-dc9fb32be8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.805438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a025ac-7f67-4756-b01d-dc9fb32be8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.806355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a025ac-7f67-4756-b01d-dc9fb32be8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:56.809244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a025ac-7f67-4756-b01d-dc9fb32be8fe admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.816191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 962/1906] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:56.821953 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5432b19-09d0-4592-ab67-816f6f947870 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.832214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5432b19-09d0-4592-ab67-816f6f947870 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:56.837312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2f6d-8213-4140-b64a-5d6a5ea42f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:56.838295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2f6d-8213-4140-b64a-5d6a5ea42f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:56.838586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2f6d-8213-4140-b64a-5d6a5ea42f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:56.841278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2f6d-8213-4140-b64a-5d6a5ea42f8c admin admin] PATH_INFO: `/v3/projects/648164531b8c4f07aa1abeb8b3526e0d/users/ead9047f7a04461b8f24328a7a945cb8/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:56.854532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd2f6d-8213-4140-b64a-5d6a5ea42f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=648164531b8c4f07aa1abeb8b3526e0d, user_id=ead9047f7a04461b8f24328a7a945cb8, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:56.864477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd2f6d-8213-4140-b64a-5d6a5ea42f8c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.883251 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 945/1907] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:56 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:56.887057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a025ac-7f67-4756-b01d-dc9fb32be8fe admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.932885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 963/1908] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:56 2022] PUT /identity/v3/projects/648164531b8c4f07aa1abeb8b3526e0d/users/ead9047f7a04461b8f24328a7a945cb8/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:56.936695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2f6d-8213-4140-b64a-5d6a5ea42f8c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:56.956687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a025ac-7f67-4756-b01d-dc9fb32be8fe admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.034088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2f6d-8213-4140-b64a-5d6a5ea42f8c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.038838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41069d7-e785-465e-9e59-fc13b6855edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.039597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41069d7-e785-465e-9e59-fc13b6855edc admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.039893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41069d7-e785-465e-9e59-fc13b6855edc admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.040176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41069d7-e785-465e-9e59-fc13b6855edc admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.040759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6ed91-ede7-444a-8da9-4f6df0d07581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.041169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41069d7-e785-465e-9e59-fc13b6855edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.041991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6ed91-ede7-444a-8da9-4f6df0d07581 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.043442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6ed91-ede7-444a-8da9-4f6df0d07581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.043557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41069d7-e785-465e-9e59-fc13b6855edc admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.055784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6ed91-ede7-444a-8da9-4f6df0d07581 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.058746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6ed91-ede7-444a-8da9-4f6df0d07581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.067570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6ed91-ede7-444a-8da9-4f6df0d07581 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.090712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 964/1909] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:51:57.107295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6ed91-ede7-444a-8da9-4f6df0d07581 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.121586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6ed91-ede7-444a-8da9-4f6df0d07581 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.127816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69063d5-1178-47fb-810d-bed75ee04c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.128724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 946/1910] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:56 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:57.130016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69063d5-1178-47fb-810d-bed75ee04c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.130673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69063d5-1178-47fb-810d-bed75ee04c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.131184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69063d5-1178-47fb-810d-bed75ee04c90 admin admin] PATH_INFO: `/v3/projects/648164531b8c4f07aa1abeb8b3526e0d/users/ead9047f7a04461b8f24328a7a945cb8/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.134542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41069d7-e785-465e-9e59-fc13b6855edc admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.143909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69063d5-1178-47fb-810d-bed75ee04c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648164531b8c4f07aa1abeb8b3526e0d, user_id=ead9047f7a04461b8f24328a7a945cb8, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.150250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69063d5-1178-47fb-810d-bed75ee04c90 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.151536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41069d7-e785-465e-9e59-fc13b6855edc admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.171734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfae0ef-e8ee-4cda-8a32-6d6697b10cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.172486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfae0ef-e8ee-4cda-8a32-6d6697b10cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.172853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfae0ef-e8ee-4cda-8a32-6d6697b10cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.173045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfae0ef-e8ee-4cda-8a32-6d6697b10cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.173822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfae0ef-e8ee-4cda-8a32-6d6697b10cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.178253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfae0ef-e8ee-4cda-8a32-6d6697b10cb7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.196082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 947/1912] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:51:57.200570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfae0ef-e8ee-4cda-8a32-6d6697b10cb7 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.202669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 965/1912] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:57 2022] PUT /identity/v3/projects/648164531b8c4f07aa1abeb8b3526e0d/users/ead9047f7a04461b8f24328a7a945cb8/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:57.206280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e8d6d-f80b-4ba6-918a-9e679b86da50 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.206406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e8d6d-f80b-4ba6-918a-9e679b86da50 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.206657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e8d6d-f80b-4ba6-918a-9e679b86da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.221797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfae0ef-e8ee-4cda-8a32-6d6697b10cb7 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.251751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:57.284469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-403e8d6d-f80b-4ba6-918a-9e679b86da50 None None] MFA Rules not processed for user `ead9047f7a04461b8f24328a7a945cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:57.286962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-403e8d6d-f80b-4ba6-918a-9e679b86da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:57.306504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dd5fb-eb6e-4cb9-a86d-58879205bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.307867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dd5fb-eb6e-4cb9-a86d-58879205bb3f admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.308241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dd5fb-eb6e-4cb9-a86d-58879205bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.309134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dd5fb-eb6e-4cb9-a86d-58879205bb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.310466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dd5fb-eb6e-4cb9-a86d-58879205bb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.313606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dd5fb-eb6e-4cb9-a86d-58879205bb3f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.344793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 948/1913] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:57.350991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dd5fb-eb6e-4cb9-a86d-58879205bb3f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.372142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dd5fb-eb6e-4cb9-a86d-58879205bb3f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.379092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ae34f-1d27-424b-8689-3035a0f31deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.380188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ae34f-1d27-424b-8689-3035a0f31deb admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.380650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ae34f-1d27-424b-8689-3035a0f31deb admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.381088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ae34f-1d27-424b-8689-3035a0f31deb admin admin] PATH_INFO: `/v3/projects/538e944f4f9246d592ff19ce9ff3a476/users/be6367cd05f84e9dbacba052aa0285d8/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.420357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ae34f-1d27-424b-8689-3035a0f31deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=538e944f4f9246d592ff19ce9ff3a476, user_id=be6367cd05f84e9dbacba052aa0285d8, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.420357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ae34f-1d27-424b-8689-3035a0f31deb admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.421052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 966/1914] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:57.428123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e8d6d-f80b-4ba6-918a-9e679b86da50 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.429606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-403e8d6d-f80b-4ba6-918a-9e679b86da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:57.506906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e8d6d-f80b-4ba6-918a-9e679b86da50 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.510801 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baec24b-34ab-4c69-944f-5658f98795ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.511555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baec24b-34ab-4c69-944f-5658f98795ff service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.512194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baec24b-34ab-4c69-944f-5658f98795ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.512194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baec24b-34ab-4c69-944f-5658f98795ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.530086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baec24b-34ab-4c69-944f-5658f98795ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.535034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baec24b-34ab-4c69-944f-5658f98795ff service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.544907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 949/1915] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:57 2022] PUT /identity/v3/projects/538e944f4f9246d592ff19ce9ff3a476/users/be6367cd05f84e9dbacba052aa0285d8/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:57.545893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ae34f-1d27-424b-8689-3035a0f31deb admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.555725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-256ae34f-1d27-424b-8689-3035a0f31deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:57.555914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 967/1916] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:57.557521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0292c-7cc8-46e1-8319-58a2bbcf62a5 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.557817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0292c-7cc8-46e1-8319-58a2bbcf62a5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.558227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0292c-7cc8-46e1-8319-58a2bbcf62a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.591897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1db0292c-7cc8-46e1-8319-58a2bbcf62a5 None None] MFA Rules not processed for user `be6367cd05f84e9dbacba052aa0285d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:57.593164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1db0292c-7cc8-46e1-8319-58a2bbcf62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:57.650565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ae34f-1d27-424b-8689-3035a0f31deb admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.662036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.668034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.668034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.668034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] PATH_INFO: `/v3/projects/1c64a8490f7e41ef84b2c3e7646ba015` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.668034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c64a8490f7e41ef84b2c3e7646ba015)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.668034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.682561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 968/1917] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:57.687081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0292c-7cc8-46e1-8319-58a2bbcf62a5 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.700593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0292c-7cc8-46e1-8319-58a2bbcf62a5 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.705482 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857daf38-2f4c-48d1-bd10-e3888c52c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.706309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857daf38-2f4c-48d1-bd10-e3888c52c12e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.706826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857daf38-2f4c-48d1-bd10-e3888c52c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.707211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857daf38-2f4c-48d1-bd10-e3888c52c12e admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.708545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857daf38-2f4c-48d1-bd10-e3888c52c12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.710665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857daf38-2f4c-48d1-bd10-e3888c52c12e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.819768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 969/1918] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:57 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:57.824065 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857daf38-2f4c-48d1-bd10-e3888c52c12e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.837378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c64a8490f7e41ef84b2c3e7646ba015', 'request_id': 'req-905366e8-4665-448a-95c2-2e9995638fc9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:57.844779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c64a8490f7e41ef84b2c3e7646ba015', 'request_id': 'req-905366e8-4665-448a-95c2-2e9995638fc9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:57.890151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857daf38-2f4c-48d1-bd10-e3888c52c12e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.895329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc7f62-5896-4bb4-858a-f9cd4385ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.896149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7f62-5896-4bb4-858a-f9cd4385ba4f admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.896437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7f62-5896-4bb4-858a-f9cd4385ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.896714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7f62-5896-4bb4-858a-f9cd4385ba4f admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.897480 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc7f62-5896-4bb4-858a-f9cd4385ba4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.899404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc7f62-5896-4bb4-858a-f9cd4385ba4f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:57.925274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c64a8490f7e41ef84b2c3e7646ba015', 'request_id': 'req-905366e8-4665-448a-95c2-2e9995638fc9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:57.936562 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] The token cache is being invalidate because project 1c64a8490f7e41ef84b2c3e7646ba015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:57.936767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:57.944878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:57.944878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 950/1919] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:57 2022] DELETE /identity/v3/projects/1c64a8490f7e41ef84b2c3e7646ba015 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:57.947369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.948793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:57.967730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 970/1920] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:57 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:57.971013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc7f62-5896-4bb4-858a-f9cd4385ba4f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:57.973445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-54fc7f62-5896-4bb4-858a-f9cd4385ba4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:57.986396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc7f62-5896-4bb4-858a-f9cd4385ba4f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:57.992604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a29b4-4cc1-4374-870d-6f9330380327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:57.993305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a29b4-4cc1-4374-870d-6f9330380327 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:57.998329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a29b4-4cc1-4374-870d-6f9330380327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:57.998329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a29b4-4cc1-4374-870d-6f9330380327 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:57.998329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a29b4-4cc1-4374-870d-6f9330380327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:57.998329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a29b4-4cc1-4374-870d-6f9330380327 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:58.008105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 971/1921] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:51:58.012275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a29b4-4cc1-4374-870d-6f9330380327 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:58.023036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a29b4-4cc1-4374-870d-6f9330380327 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:58.028185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb586c-6e67-455a-88a9-1a11e56349ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:58.029399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb586c-6e67-455a-88a9-1a11e56349ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:58.029399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb586c-6e67-455a-88a9-1a11e56349ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:58.040189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb586c-6e67-455a-88a9-1a11e56349ae admin admin] PATH_INFO: `/v3/projects/351d34f1a435409abe1c04098da46376/users/c319cc3163a4478f86299d9c59ca6eeb/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:58.040770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905366e8-4665-448a-95c2-2e9995638fc9 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:58.040770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:58.040770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:58.040770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:58.041053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] PATH_INFO: `/v3/users/29e983f30c794f1184e646d5a15f557d` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:58.041053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e983f30c794f1184e646d5a15f557d)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:58.042726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:58.044777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb586c-6e67-455a-88a9-1a11e56349ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=351d34f1a435409abe1c04098da46376, user_id=c319cc3163a4478f86299d9c59ca6eeb, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:58.047524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb586c-6e67-455a-88a9-1a11e56349ae admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:58.104419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 972/1922] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:58 2022] PUT /identity/v3/projects/351d34f1a435409abe1c04098da46376/users/c319cc3163a4478f86299d9c59ca6eeb/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:58.108064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb586c-6e67-455a-88a9-1a11e56349ae admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:58.124005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:58.208663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e983f30c794f1184e646d5a15f557d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:58.221383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb586c-6e67-455a-88a9-1a11e56349ae admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:58.230763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3c290-4085-43e1-9124-6141d7684ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:58.231731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c290-4085-43e1-9124-6141d7684ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:58.232173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c290-4085-43e1-9124-6141d7684ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:58.232957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c290-4085-43e1-9124-6141d7684ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:58.233928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3c290-4085-43e1-9124-6141d7684ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:58.235951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3c290-4085-43e1-9124-6141d7684ce9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:58.251941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 973/1923] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:58.258507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3c290-4085-43e1-9124-6141d7684ce9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:58.278657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3c290-4085-43e1-9124-6141d7684ce9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:58.285503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e983f30c794f1184e646d5a15f557d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:58.285700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093475cf-8be5-4dd3-9fda-f8954e5ef87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:58.286466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093475cf-8be5-4dd3-9fda-f8954e5ef87a admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:58.286843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093475cf-8be5-4dd3-9fda-f8954e5ef87a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:58.286963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e983f30c794f1184e646d5a15f557d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:58.287135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093475cf-8be5-4dd3-9fda-f8954e5ef87a admin admin] PATH_INFO: `/v3/projects/351d34f1a435409abe1c04098da46376/users/c319cc3163a4478f86299d9c59ca6eeb/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:58.289555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093475cf-8be5-4dd3-9fda-f8954e5ef87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=351d34f1a435409abe1c04098da46376, user_id=c319cc3163a4478f86299d9c59ca6eeb, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:58.292868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093475cf-8be5-4dd3-9fda-f8954e5ef87a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:58.304607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e983f30c794f1184e646d5a15f557d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:58.305975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e983f30c794f1184e646d5a15f557d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:58.306358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 974/1924] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:58 2022] PUT /identity/v3/projects/351d34f1a435409abe1c04098da46376/users/c319cc3163a4478f86299d9c59ca6eeb/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:58.316574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0567696-3215-4576-b96e-4415f81cba20 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:58.317612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0567696-3215-4576-b96e-4415f81cba20 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:58.317972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0567696-3215-4576-b96e-4415f81cba20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:58.329993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 951/1925] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:57 2022] DELETE /identity/v3/users/29e983f30c794f1184e646d5a15f557d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:58.359890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f0567696-3215-4576-b96e-4415f81cba20 None None] MFA Rules not processed for user `c319cc3163a4478f86299d9c59ca6eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:58.361537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f0567696-3215-4576-b96e-4415f81cba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:58.461643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 975/1926] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:51:58.473008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:58.474525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:58.540474 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9a5f-8eb4-47bc-b4ef-827d33115a21 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:58.545106 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:58.546394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:58.546394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:58.546394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:58.548179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:58.655879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:58.657361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:58.670819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 952/1927] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:58.694488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0567696-3215-4576-b96e-4415f81cba20 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:58.696105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f0567696-3215-4576-b96e-4415f81cba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:58.713890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0567696-3215-4576-b96e-4415f81cba20 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:58.720687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7855f-521c-4601-aa71-a9ca872d9a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:58.721540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7855f-521c-4601-aa71-a9ca872d9a11 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:58.721923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7855f-521c-4601-aa71-a9ca872d9a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:58.722328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7855f-521c-4601-aa71-a9ca872d9a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:58.725535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-32b7855f-521c-4601-aa71-a9ca872d9a11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:58.835518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7855f-521c-4601-aa71-a9ca872d9a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:58.837603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7855f-521c-4601-aa71-a9ca872d9a11 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:58.849130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 976/1928] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:58.887836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:58.889333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:58.990630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ca973-f9d6-4c54-b810-cc766eb78822 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:58.995545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:58.996532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:58.996891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:58.997247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] PATH_INFO: `/v3/projects/adbacb22c1ff45e1886693d5b9a0ed6f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:58.998524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbacb22c1ff45e1886693d5b9a0ed6f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:59.000442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:59.128499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbacb22c1ff45e1886693d5b9a0ed6f', 'request_id': 'req-e57a95c2-eb1b-4327-9138-1c4300abc6ba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:59.133269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbacb22c1ff45e1886693d5b9a0ed6f', 'request_id': 'req-e57a95c2-eb1b-4327-9138-1c4300abc6ba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:59.205316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbacb22c1ff45e1886693d5b9a0ed6f', 'request_id': 'req-e57a95c2-eb1b-4327-9138-1c4300abc6ba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:59.217329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] The token cache is being invalidate because project adbacb22c1ff45e1886693d5b9a0ed6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:59.217616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:59.218252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e57a95c2-eb1b-4327-9138-1c4300abc6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:59.219803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 953/1929] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:58 2022] DELETE /identity/v3/projects/adbacb22c1ff45e1886693d5b9a0ed6f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:59.224725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea200e-5089-4012-b88b-371b55f3efd3 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:59.225226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea200e-5089-4012-b88b-371b55f3efd3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:59.225337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea200e-5089-4012-b88b-371b55f3efd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:59.250495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b6ea200e-5089-4012-b88b-371b55f3efd3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:59.250495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b6ea200e-5089-4012-b88b-371b55f3efd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:59.317933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 977/1930] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:59.325840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b49d-0052-49c7-8d1d-18e065db1339 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:59.326163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b49d-0052-49c7-8d1d-18e065db1339 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:59.326450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b49d-0052-49c7-8d1d-18e065db1339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:59.363929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-7ff0b49d-0052-49c7-8d1d-18e065db1339 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:59.365716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-7ff0b49d-0052-49c7-8d1d-18e065db1339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:59.384085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea200e-5089-4012-b88b-371b55f3efd3 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:59.392379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 954/1931] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:59.397929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea200e-5089-4012-b88b-371b55f3efd3 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:59.405644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b5a7e-78f8-48e8-a684-5227131b5b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:59.406361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b5a7e-78f8-48e8-a684-5227131b5b86 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:59.406649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b5a7e-78f8-48e8-a684-5227131b5b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:59.410849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b5a7e-78f8-48e8-a684-5227131b5b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:59.410849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b5a7e-78f8-48e8-a684-5227131b5b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:59.410849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b5a7e-78f8-48e8-a684-5227131b5b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:59.410849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b5a7e-78f8-48e8-a684-5227131b5b86 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:59.421984 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 978/1932] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:59.426772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b49d-0052-49c7-8d1d-18e065db1339 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:59.436389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b49d-0052-49c7-8d1d-18e065db1339 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:59.440999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a71d-bcf9-4f59-8c7b-a7976fbeca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:59.442270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a71d-bcf9-4f59-8c7b-a7976fbeca8b admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:59.442557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a71d-bcf9-4f59-8c7b-a7976fbeca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:59.442835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a71d-bcf9-4f59-8c7b-a7976fbeca8b admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:59.443559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3a71d-bcf9-4f59-8c7b-a7976fbeca8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:59.445607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3a71d-bcf9-4f59-8c7b-a7976fbeca8b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:59.562782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 955/1933] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:59 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:59.566912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b5a7e-78f8-48e8-a684-5227131b5b86 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:59.577159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b5a7e-78f8-48e8-a684-5227131b5b86 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:59.697024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a3ecb-6bb0-4650-a69e-36ae40310cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:59.699291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a3ecb-6bb0-4650-a69e-36ae40310cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:59.699291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a3ecb-6bb0-4650-a69e-36ae40310cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:59.699291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a3ecb-6bb0-4650-a69e-36ae40310cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:59.699291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a3ecb-6bb0-4650-a69e-36ae40310cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:59.703311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a3ecb-6bb0-4650-a69e-36ae40310cf8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:59.804917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 979/1934] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:59 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:59.807157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a71d-bcf9-4f59-8c7b-a7976fbeca8b admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:59.825819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a71d-bcf9-4f59-8c7b-a7976fbeca8b admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:59.833992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354ff4e-9e62-4a0b-b7f2-d4f1e1196638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:59.834985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354ff4e-9e62-4a0b-b7f2-d4f1e1196638 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:59.835735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354ff4e-9e62-4a0b-b7f2-d4f1e1196638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:59.836368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354ff4e-9e62-4a0b-b7f2-d4f1e1196638 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:59.837281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354ff4e-9e62-4a0b-b7f2-d4f1e1196638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:59.840016 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354ff4e-9e62-4a0b-b7f2-d4f1e1196638 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:59.859116 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 956/1935] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:59.860888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a3ecb-6bb0-4650-a69e-36ae40310cf8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:59.874404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a3ecb-6bb0-4650-a69e-36ae40310cf8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:59.886093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebd5ae-80d1-4419-adce-d34f4670bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:59.886825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebd5ae-80d1-4419-adce-d34f4670bfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:59.887113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebd5ae-80d1-4419-adce-d34f4670bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:59.887395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebd5ae-80d1-4419-adce-d34f4670bfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:59.888148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebd5ae-80d1-4419-adce-d34f4670bfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:59.889859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebd5ae-80d1-4419-adce-d34f4670bfc9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:59.913507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 980/1936] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:59.917711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354ff4e-9e62-4a0b-b7f2-d4f1e1196638 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:59.927394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:59.938008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354ff4e-9e62-4a0b-b7f2-d4f1e1196638 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:59.953882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc269-4348-43be-b95d-02b374fdd75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:59.955027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc269-4348-43be-b95d-02b374fdd75c admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:59.955321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc269-4348-43be-b95d-02b374fdd75c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:59.958134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc269-4348-43be-b95d-02b374fdd75c admin admin] PATH_INFO: `/v3/projects/2b99556966554cdfa28c3c9e131942af/users/4f816602ef3744459df95c02e4b3c6e2/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:59.980172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debc269-4348-43be-b95d-02b374fdd75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b99556966554cdfa28c3c9e131942af, user_id=4f816602ef3744459df95c02e4b3c6e2, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:59.983714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debc269-4348-43be-b95d-02b374fdd75c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:00.106285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 957/1937] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:59 2022] PUT /identity/v3/projects/2b99556966554cdfa28c3c9e131942af/users/4f816602ef3744459df95c02e4b3c6e2/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:00.123662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838bb80-5192-4a6a-be9c-e38331639beb None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:00.123957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838bb80-5192-4a6a-be9c-e38331639beb None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:00.124281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838bb80-5192-4a6a-be9c-e38331639beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:00.179032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-2838bb80-5192-4a6a-be9c-e38331639beb None None] MFA Rules not processed for user `4f816602ef3744459df95c02e4b3c6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:00.180420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2838bb80-5192-4a6a-be9c-e38331639beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:00.258053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 981/1938] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:00.261776 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc269-4348-43be-b95d-02b374fdd75c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:00.324799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc269-4348-43be-b95d-02b374fdd75c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:00.329512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d11d5b-9baf-4153-bc41-2cea547e96a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:00.330182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d11d5b-9baf-4153-bc41-2cea547e96a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:00.330471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d11d5b-9baf-4153-bc41-2cea547e96a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:00.330749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d11d5b-9baf-4153-bc41-2cea547e96a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:00.331522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d11d5b-9baf-4153-bc41-2cea547e96a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:00.334086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d11d5b-9baf-4153-bc41-2cea547e96a2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:00.415606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 958/1939] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:00 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:00.416747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838bb80-5192-4a6a-be9c-e38331639beb None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:00.427725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838bb80-5192-4a6a-be9c-e38331639beb None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:00.487523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:00.494874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cab05-d8a6-4ca8-8ee7-645678522bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:00.495561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cab05-d8a6-4ca8-8ee7-645678522bbc admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:00.495851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cab05-d8a6-4ca8-8ee7-645678522bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:00.496132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cab05-d8a6-4ca8-8ee7-645678522bbc admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:00.496851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cab05-d8a6-4ca8-8ee7-645678522bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:00.498886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cab05-d8a6-4ca8-8ee7-645678522bbc admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:00.600152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 982/1940] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:00 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:00.601882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d11d5b-9baf-4153-bc41-2cea547e96a2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:00.614357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d11d5b-9baf-4153-bc41-2cea547e96a2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:00.619942 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e20374-878d-4765-a970-acdfe307d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:00.620852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e20374-878d-4765-a970-acdfe307d4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:00.621641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e20374-878d-4765-a970-acdfe307d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:00.622255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e20374-878d-4765-a970-acdfe307d4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:00.623687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e20374-878d-4765-a970-acdfe307d4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:00.625870 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e20374-878d-4765-a970-acdfe307d4f5 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:00.642756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 959/1941] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:00.644414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cab05-d8a6-4ca8-8ee7-645678522bbc admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:00.658352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cab05-d8a6-4ca8-8ee7-645678522bbc admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:00.663186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8863-dff6-43b4-815d-1796b207bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:00.664090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8863-dff6-43b4-815d-1796b207bec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:00.664375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8863-dff6-43b4-815d-1796b207bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:00.664651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8863-dff6-43b4-815d-1796b207bec2 admin admin] PATH_INFO: `/v3/projects/3d3a68f2aeda4f91a83ee67560dabb51/users/055ee2274f994adab46920fcd446084d/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:00.683261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd8863-dff6-43b4-815d-1796b207bec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a68f2aeda4f91a83ee67560dabb51, user_id=055ee2274f994adab46920fcd446084d, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:00.686260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd8863-dff6-43b4-815d-1796b207bec2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:00.748168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 983/1942] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:00 2022] PUT /identity/v3/projects/3d3a68f2aeda4f91a83ee67560dabb51/users/055ee2274f994adab46920fcd446084d/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:00.751995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e20374-878d-4765-a970-acdfe307d4f5 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:00.763177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e20374-878d-4765-a970-acdfe307d4f5 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:00.874912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cabd2a-b387-4271-850a-d1e5c2e73b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:00.883141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cabd2a-b387-4271-850a-d1e5c2e73b13 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:00.883141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cabd2a-b387-4271-850a-d1e5c2e73b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:00.883141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cabd2a-b387-4271-850a-d1e5c2e73b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:00.883141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cabd2a-b387-4271-850a-d1e5c2e73b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:00.883141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cabd2a-b387-4271-850a-d1e5c2e73b13 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:00.917648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 960/1943] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:00.922621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8863-dff6-43b4-815d-1796b207bec2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:00.938101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8863-dff6-43b4-815d-1796b207bec2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:00.951498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e389616-a2d6-4603-b5ba-64606fe61566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:00.952480 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389616-a2d6-4603-b5ba-64606fe61566 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:00.952778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389616-a2d6-4603-b5ba-64606fe61566 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:00.953059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389616-a2d6-4603-b5ba-64606fe61566 admin admin] PATH_INFO: `/v3/projects/3d3a68f2aeda4f91a83ee67560dabb51/users/055ee2274f994adab46920fcd446084d/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:00.957886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e389616-a2d6-4603-b5ba-64606fe61566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a68f2aeda4f91a83ee67560dabb51, user_id=055ee2274f994adab46920fcd446084d, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:00.960594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e389616-a2d6-4603-b5ba-64606fe61566 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:00.992764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 984/1944] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:00 2022] PUT /identity/v3/projects/3d3a68f2aeda4f91a83ee67560dabb51/users/055ee2274f994adab46920fcd446084d/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:01.009222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8e55-9909-4e65-ac26-41b388838cc6 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:01.009737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8e55-9909-4e65-ac26-41b388838cc6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:01.011292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8e55-9909-4e65-ac26-41b388838cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:01.047735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-42ac8e55-9909-4e65-ac26-41b388838cc6 None None] MFA Rules not processed for user `055ee2274f994adab46920fcd446084d`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:01.059416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-42ac8e55-9909-4e65-ac26-41b388838cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:01.148376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 961/1945] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:01.178887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e389616-a2d6-4603-b5ba-64606fe61566 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:01.181041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6e389616-a2d6-4603-b5ba-64606fe61566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:01.252922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e389616-a2d6-4603-b5ba-64606fe61566 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:01.258183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e15e4-426d-4d08-b2e0-f1422d3d20f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:01.262093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e15e4-426d-4d08-b2e0-f1422d3d20f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:01.262093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e15e4-426d-4d08-b2e0-f1422d3d20f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:01.262093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e15e4-426d-4d08-b2e0-f1422d3d20f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:01.270523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e15e4-426d-4d08-b2e0-f1422d3d20f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:01.272140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e15e4-426d-4d08-b2e0-f1422d3d20f7 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:01.286249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 985/1946] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:01.664645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:01.886604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:02.983922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8e55-9909-4e65-ac26-41b388838cc6 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:03.052499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8e55-9909-4e65-ac26-41b388838cc6 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:03.057786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:03.058137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:03.058436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:03.058722 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] PATH_INFO: `/v3/users/4f816602ef3744459df95c02e4b3c6e2` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:03.060363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f816602ef3744459df95c02e4b3c6e2)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:03.062385 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:03.150249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:03.266658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f816602ef3744459df95c02e4b3c6e2'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.399384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f816602ef3744459df95c02e4b3c6e2'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.400018 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f816602ef3744459df95c02e4b3c6e2'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.414569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f816602ef3744459df95c02e4b3c6e2'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.414569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f816602ef3744459df95c02e4b3c6e2'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.427369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 962/1947] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:02 2022] DELETE /identity/v3/users/4f816602ef3744459df95c02e4b3c6e2 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:03.431826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c785b-b26f-4405-ba59-95d276480800 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:03.432115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c785b-b26f-4405-ba59-95d276480800 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:03.432395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c785b-b26f-4405-ba59-95d276480800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:03.450721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-280c785b-b26f-4405-ba59-95d276480800 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:03.454938 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-280c785b-b26f-4405-ba59-95d276480800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:03.512263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 986/1948] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:03.521786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:03.523270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:03.602317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280174-2201-4180-ba09-54d2b72b7194 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:03.607065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec754b-50f8-4151-b692-2cd917cb4ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:03.607934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec754b-50f8-4151-b692-2cd917cb4ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:03.608370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec754b-50f8-4151-b692-2cd917cb4ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:03.608826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec754b-50f8-4151-b692-2cd917cb4ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:03.621010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec754b-50f8-4151-b692-2cd917cb4ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:03.623414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec754b-50f8-4151-b692-2cd917cb4ac0 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:03.639749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 963/1949] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:04.076477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:04.253103 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c785b-b26f-4405-ba59-95d276480800 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.257966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-280c785b-b26f-4405-ba59-95d276480800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:04.277306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c785b-b26f-4405-ba59-95d276480800 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.283886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.284854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.285449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.286030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] PATH_INFO: `/v3/projects/2b99556966554cdfa28c3c9e131942af` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.287600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b99556966554cdfa28c3c9e131942af)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.290717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.458317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b99556966554cdfa28c3c9e131942af', 'request_id': 'req-10af5dff-496f-4993-9a4a-0569176ab41b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.546195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec754b-50f8-4151-b692-2cd917cb4ac0 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.548010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-abec754b-50f8-4151-b692-2cd917cb4ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:04.554967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b99556966554cdfa28c3c9e131942af', 'request_id': 'req-10af5dff-496f-4993-9a4a-0569176ab41b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.564375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b99556966554cdfa28c3c9e131942af', 'request_id': 'req-10af5dff-496f-4993-9a4a-0569176ab41b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.595492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] The token cache is being invalidate because project 2b99556966554cdfa28c3c9e131942af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:04.597226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.598061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.601745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 987/1950] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:04 2022] DELETE /identity/v3/projects/2b99556966554cdfa28c3c9e131942af => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:04.605746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.610310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:04.667580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec754b-50f8-4151-b692-2cd917cb4ac0 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.749179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.749755 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.750151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.750493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.753288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:04.793764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af5dff-496f-4993-9a4a-0569176ab41b admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.798826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.799714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.800166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.800586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] PATH_INFO: `/v3/users/055ee2274f994adab46920fcd446084d` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.802623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055ee2274f994adab46920fcd446084d)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.810897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.845183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.846910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.879197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 964/1951] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:05.057171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055ee2274f994adab46920fcd446084d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:05.095081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:05.098249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:05.115953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5da799-8211-4317-9089-c487202563c9 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:05.119312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c757b99-a72d-488d-ab60-a356e991974a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:05.120203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c757b99-a72d-488d-ab60-a356e991974a service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.120496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c757b99-a72d-488d-ab60-a356e991974a service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.120784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c757b99-a72d-488d-ab60-a356e991974a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.122630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-7c757b99-a72d-488d-ab60-a356e991974a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:05.142391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055ee2274f994adab46920fcd446084d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:05.156549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055ee2274f994adab46920fcd446084d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:05.158231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055ee2274f994adab46920fcd446084d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:05.168159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055ee2274f994adab46920fcd446084d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:05.178685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 988/1952] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:04 2022] DELETE /identity/v3/users/055ee2274f994adab46920fcd446084d => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:05.213177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c757b99-a72d-488d-ab60-a356e991974a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:05.215059 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c757b99-a72d-488d-ab60-a356e991974a service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:05.226509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 965/1953] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:05.849580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:05.851148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:05.934771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:05.939639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e4622-ce41-4d6d-93f5-d081a27610a6 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:05.947629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:05.948523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.948812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.949090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] PATH_INFO: `/v3/projects/3d3a68f2aeda4f91a83ee67560dabb51` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.950542 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3a68f2aeda4f91a83ee67560dabb51)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:05.952494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:06.059044 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3a68f2aeda4f91a83ee67560dabb51', 'request_id': 'req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:06.137025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3a68f2aeda4f91a83ee67560dabb51', 'request_id': 'req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:06.144589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3a68f2aeda4f91a83ee67560dabb51', 'request_id': 'req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:06.156484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] The token cache is being invalidate because project 3d3a68f2aeda4f91a83ee67560dabb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:06.156974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:06.157866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f49782a5-b76c-40b6-ad86-d1b94d67a7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:06.160338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 989/1954] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:05 2022] DELETE /identity/v3/projects/3d3a68f2aeda4f91a83ee67560dabb51 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:06.165424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b4b4e-2614-4d35-a70f-ea7e73bbe02c None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:06.170128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b4b4e-2614-4d35-a70f-ea7e73bbe02c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:06.170128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b4b4e-2614-4d35-a70f-ea7e73bbe02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:06.190870 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-636b4b4e-2614-4d35-a70f-ea7e73bbe02c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:06.193036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-636b4b4e-2614-4d35-a70f-ea7e73bbe02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:06.295148 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 966/1955] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:06.303861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab72ddc-563c-407c-8d9b-4b9012c7e97c None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:06.307396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab72ddc-563c-407c-8d9b-4b9012c7e97c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:06.307396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab72ddc-563c-407c-8d9b-4b9012c7e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:06.326543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-bab72ddc-563c-407c-8d9b-4b9012c7e97c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:06.327843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bab72ddc-563c-407c-8d9b-4b9012c7e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:06.362180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 990/1956] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:06.365798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b4b4e-2614-4d35-a70f-ea7e73bbe02c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:06.376012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b4b4e-2614-4d35-a70f-ea7e73bbe02c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:06.389605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d694a-5daf-40d4-87ff-bd37875e77a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:06.390594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d694a-5daf-40d4-87ff-bd37875e77a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:06.391419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d694a-5daf-40d4-87ff-bd37875e77a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:06.391419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d694a-5daf-40d4-87ff-bd37875e77a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:06.391904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d694a-5daf-40d4-87ff-bd37875e77a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:06.392254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d694a-5daf-40d4-87ff-bd37875e77a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:06.393979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d694a-5daf-40d4-87ff-bd37875e77a0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:06.415129 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 967/1957] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:06.418562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab72ddc-563c-407c-8d9b-4b9012c7e97c None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:06.433838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab72ddc-563c-407c-8d9b-4b9012c7e97c None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:06.441655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd18cf-0613-4c53-8e9b-8ad943bc7b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:06.442948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd18cf-0613-4c53-8e9b-8ad943bc7b39 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:06.442948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd18cf-0613-4c53-8e9b-8ad943bc7b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:06.443189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd18cf-0613-4c53-8e9b-8ad943bc7b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:06.444074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd18cf-0613-4c53-8e9b-8ad943bc7b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:06.446257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd18cf-0613-4c53-8e9b-8ad943bc7b39 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:06.584762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 991/1958] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:06 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:06.589882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d694a-5daf-40d4-87ff-bd37875e77a0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:06.601130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d694a-5daf-40d4-87ff-bd37875e77a0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:06.663269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cccdc1-a094-49b8-8d6e-101d7d27c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:06.664205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cccdc1-a094-49b8-8d6e-101d7d27c9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:06.664500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cccdc1-a094-49b8-8d6e-101d7d27c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:06.664960 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cccdc1-a094-49b8-8d6e-101d7d27c9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:06.671526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cccdc1-a094-49b8-8d6e-101d7d27c9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:06.671526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cccdc1-a094-49b8-8d6e-101d7d27c9d4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:06.768786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd18cf-0613-4c53-8e9b-8ad943bc7b39 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:06.777560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 968/1959] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:06 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:06.781680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd18cf-0613-4c53-8e9b-8ad943bc7b39 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:06.787888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179ae1a-6004-404f-9db9-0beeecab92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:06.792085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179ae1a-6004-404f-9db9-0beeecab92e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:06.792085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179ae1a-6004-404f-9db9-0beeecab92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:06.792085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179ae1a-6004-404f-9db9-0beeecab92e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:06.792085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179ae1a-6004-404f-9db9-0beeecab92e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:06.792085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179ae1a-6004-404f-9db9-0beeecab92e3 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:06.806227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 992/1960] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:06.810621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cccdc1-a094-49b8-8d6e-101d7d27c9d4 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:06.821376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cccdc1-a094-49b8-8d6e-101d7d27c9d4 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:06.829520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4014bd-6feb-4e63-a662-e0cb64b721ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:06.830223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4014bd-6feb-4e63-a662-e0cb64b721ca admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:06.830510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4014bd-6feb-4e63-a662-e0cb64b721ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:06.830784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4014bd-6feb-4e63-a662-e0cb64b721ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:06.831515 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4014bd-6feb-4e63-a662-e0cb64b721ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:06.833742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4014bd-6feb-4e63-a662-e0cb64b721ca admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:06.841368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:06.849655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 969/1961] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:06.858962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179ae1a-6004-404f-9db9-0beeecab92e3 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:06.869663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179ae1a-6004-404f-9db9-0beeecab92e3 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:06.876067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e734-b13b-4216-8d12-95a8f013ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:06.877191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e734-b13b-4216-8d12-95a8f013ba1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:06.877561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e734-b13b-4216-8d12-95a8f013ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:06.877903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e734-b13b-4216-8d12-95a8f013ba1e admin admin] PATH_INFO: `/v3/projects/53f13414a52a4af69df23335ba5a1640/users/c4dba785eba04aa99014859bc0f967b0/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:06.908871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:06.912846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734e734-b13b-4216-8d12-95a8f013ba1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f13414a52a4af69df23335ba5a1640, user_id=c4dba785eba04aa99014859bc0f967b0, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:06.916597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734e734-b13b-4216-8d12-95a8f013ba1e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:06.977817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 993/1962] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:06 2022] PUT /identity/v3/projects/53f13414a52a4af69df23335ba5a1640/users/c4dba785eba04aa99014859bc0f967b0/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:06.990831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4db5-de52-44de-a5b5-ff9cadf2c76f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:06.991220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4db5-de52-44de-a5b5-ff9cadf2c76f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:06.991503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4db5-de52-44de-a5b5-ff9cadf2c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:07.022190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9fea4db5-de52-44de-a5b5-ff9cadf2c76f None None] MFA Rules not processed for user `c4dba785eba04aa99014859bc0f967b0`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:07.023432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9fea4db5-de52-44de-a5b5-ff9cadf2c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:07.092624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 970/1963] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:07.104960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e734-b13b-4216-8d12-95a8f013ba1e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:07.106837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5734e734-b13b-4216-8d12-95a8f013ba1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:07.165330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e734-b13b-4216-8d12-95a8f013ba1e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:07.172556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32a48d-e41b-44ce-9fb6-a1c7863fe88a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:07.172556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a48d-e41b-44ce-9fb6-a1c7863fe88a service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:07.172556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a48d-e41b-44ce-9fb6-a1c7863fe88a service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:07.172556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a48d-e41b-44ce-9fb6-a1c7863fe88a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:07.182755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32a48d-e41b-44ce-9fb6-a1c7863fe88a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:07.184370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32a48d-e41b-44ce-9fb6-a1c7863fe88a service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:07.198502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 994/1964] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:07.554433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:08.868787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:09.950380 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea4db5-de52-44de-a5b5-ff9cadf2c76f None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:09.951920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9fea4db5-de52-44de-a5b5-ff9cadf2c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:10.031398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea4db5-de52-44de-a5b5-ff9cadf2c76f None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:10.031398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:10.031804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:10.032223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:10.032514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] PATH_INFO: `/v3/users/4328d378a9cc411f956b990feb3a4246` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:10.033723 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4328d378a9cc411f956b990feb3a4246)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:10.035753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:10.264612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4328d378a9cc411f956b990feb3a4246'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:10.342106 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4328d378a9cc411f956b990feb3a4246'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:10.347961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4328d378a9cc411f956b990feb3a4246'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:10.355369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4328d378a9cc411f956b990feb3a4246'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:10.356020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4328d378a9cc411f956b990feb3a4246'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:10.368441 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 971/1965] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:09 2022] DELETE /identity/v3/users/4328d378a9cc411f956b990feb3a4246 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:10.372920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00863c2-1958-44b5-9f88-c26caf2d694c None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:10.374537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00863c2-1958-44b5-9f88-c26caf2d694c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:10.374537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00863c2-1958-44b5-9f88-c26caf2d694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:10.392065 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c00863c2-1958-44b5-9f88-c26caf2d694c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:10.397558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c00863c2-1958-44b5-9f88-c26caf2d694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:10.439748 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:10.454240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 995/1966] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:10.464320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:10.467094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:10.523445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d61268-10ac-4bd2-8563-01d723137a85 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:10.526588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:10.528997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0ffa7-b2bb-4d37-9660-0aa1f11718c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:10.529697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0ffa7-b2bb-4d37-9660-0aa1f11718c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:10.530008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0ffa7-b2bb-4d37-9660-0aa1f11718c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:10.535417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0ffa7-b2bb-4d37-9660-0aa1f11718c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:10.539737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0ffa7-b2bb-4d37-9660-0aa1f11718c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:10.541303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0ffa7-b2bb-4d37-9660-0aa1f11718c1 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:10.551258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 972/1967] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:11.028883 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:11.092633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00863c2-1958-44b5-9f88-c26caf2d694c None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:11.094443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c00863c2-1958-44b5-9f88-c26caf2d694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:11.109599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00863c2-1958-44b5-9f88-c26caf2d694c None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:11.114614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:11.115486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:11.115775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:11.116064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] PATH_INFO: `/v3/projects/857e69f9d6f34e55acb1900a71f4b17a` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:11.117260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=857e69f9d6f34e55acb1900a71f4b17a)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:11.119232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:11.251712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857e69f9d6f34e55acb1900a71f4b17a', 'request_id': 'req-84b4cc6e-cafa-41ec-b233-5311169e65d9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.307829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857e69f9d6f34e55acb1900a71f4b17a', 'request_id': 'req-84b4cc6e-cafa-41ec-b233-5311169e65d9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.314405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857e69f9d6f34e55acb1900a71f4b17a', 'request_id': 'req-84b4cc6e-cafa-41ec-b233-5311169e65d9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.324748 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] The token cache is being invalidate because project 857e69f9d6f34e55acb1900a71f4b17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:11.325049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.325701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.327276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 996/1968] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:11 2022] DELETE /identity/v3/projects/857e69f9d6f34e55acb1900a71f4b17a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:11.339937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0ffa7-b2bb-4d37-9660-0aa1f11718c1 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:11.350395 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0ffa7-b2bb-4d37-9660-0aa1f11718c1 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:11.407334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:11.408232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:11.408516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:11.408838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] PATH_INFO: `/v3/users/24e414c9d130496f9cc3f905cc860971` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:11.410690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e414c9d130496f9cc3f905cc860971)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:11.412613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:11.623683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e414c9d130496f9cc3f905cc860971'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.696480 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e414c9d130496f9cc3f905cc860971'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.697156 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e414c9d130496f9cc3f905cc860971'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.709834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e414c9d130496f9cc3f905cc860971'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.710483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e414c9d130496f9cc3f905cc860971'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:11.722485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 973/1969] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:11 2022] DELETE /identity/v3/users/24e414c9d130496f9cc3f905cc860971 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:11.793699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:12.052017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:12.089757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:12.097078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:12.104234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4cc6e-cafa-41ec-b233-5311169e65d9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:12.163082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:12.163976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:12.164263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:12.164545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] PATH_INFO: `/v3/users/be6367cd05f84e9dbacba052aa0285d8` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:12.165747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6367cd05f84e9dbacba052aa0285d8)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:12.167725 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:12.178266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:12.179895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:12.202216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7d18a-9416-4610-885c-e143331cc038 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:12.205157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:12.206231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:12.206911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:12.206911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] PATH_INFO: `/v3/projects/22fa235aa8bd4c95be030e01e9e58c35` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:12.208485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fa235aa8bd4c95be030e01e9e58c35)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:12.210503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:12.402546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fa235aa8bd4c95be030e01e9e58c35', 'request_id': 'req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.403200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6367cd05f84e9dbacba052aa0285d8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.409048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fa235aa8bd4c95be030e01e9e58c35', 'request_id': 'req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.490974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6367cd05f84e9dbacba052aa0285d8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.503186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6367cd05f84e9dbacba052aa0285d8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.503824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6367cd05f84e9dbacba052aa0285d8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.510617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bb0534bf-d056-4ee5-af5c-6b84ba23f14b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6367cd05f84e9dbacba052aa0285d8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.516634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 997/1970] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:12 2022] DELETE /identity/v3/users/be6367cd05f84e9dbacba052aa0285d8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:12.520989 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c88fe-ced9-47dc-8157-971a63a1808b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:12.521285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c88fe-ced9-47dc-8157-971a63a1808b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:12.521570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c88fe-ced9-47dc-8157-971a63a1808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:12.538554 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1b7c88fe-ced9-47dc-8157-971a63a1808b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:12.539763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1b7c88fe-ced9-47dc-8157-971a63a1808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:12.599077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 998/1971] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:12.604836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fa235aa8bd4c95be030e01e9e58c35', 'request_id': 'req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.609356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c88fe-ced9-47dc-8157-971a63a1808b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:12.610821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1b7c88fe-ced9-47dc-8157-971a63a1808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:12.617183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] The token cache is being invalidate because project 22fa235aa8bd4c95be030e01e9e58c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:12.617510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.618201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.619886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 974/1972] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:12 2022] DELETE /identity/v3/projects/22fa235aa8bd4c95be030e01e9e58c35 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:12.623695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:12.625136 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:12.667927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c88fe-ced9-47dc-8157-971a63a1808b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:12.671683 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:12.672357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:12.672713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:12.672920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:12.674838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:12.687176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:12.688695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:12.689206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f8b5-7665-4bd6-9b04-7c11b4570856 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:12.697077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:12.698006 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:12.698298 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:12.698822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] PATH_INFO: `/v3/users/ead9047f7a04461b8f24328a7a945cb8` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:12.699148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 999/1973] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:12.699931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead9047f7a04461b8f24328a7a945cb8)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:12.701966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:12.923297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead9047f7a04461b8f24328a7a945cb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.970779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead9047f7a04461b8f24328a7a945cb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.971827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead9047f7a04461b8f24328a7a945cb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.985242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead9047f7a04461b8f24328a7a945cb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.986358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead9047f7a04461b8f24328a7a945cb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:12.998911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 975/1974] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:12 2022] DELETE /identity/v3/users/ead9047f7a04461b8f24328a7a945cb8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:13.006035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:13.062693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:13.122068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.123521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:13.137471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b502-3982-48ba-8959-efd008c7624f service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.208577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.209430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.209715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.210022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] PATH_INFO: `/v3/projects/538e944f4f9246d592ff19ce9ff3a476` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.211196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538e944f4f9246d592ff19ce9ff3a476)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.213108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.388978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538e944f4f9246d592ff19ce9ff3a476', 'request_id': 'req-da980d35-d07e-40db-81bd-399b8d99fe56'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.502341 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538e944f4f9246d592ff19ce9ff3a476', 'request_id': 'req-da980d35-d07e-40db-81bd-399b8d99fe56'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.510741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538e944f4f9246d592ff19ce9ff3a476', 'request_id': 'req-da980d35-d07e-40db-81bd-399b8d99fe56'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.521638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] The token cache is being invalidate because project 538e944f4f9246d592ff19ce9ff3a476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:13.521932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.522625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.524253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1000/1975] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:13 2022] DELETE /identity/v3/projects/538e944f4f9246d592ff19ce9ff3a476 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:13.528160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.529698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:13.543346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498ac7d-4961-4fdc-99d2-7d864d359e75 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.579588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.581031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:13.624630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.625604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.626235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.626728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] PATH_INFO: `/v3/users/c319cc3163a4478f86299d9c59ca6eeb` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.630748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c319cc3163a4478f86299d9c59ca6eeb)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.634824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.657748 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da980d35-d07e-40db-81bd-399b8d99fe56 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.665629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.666717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.666980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.667306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] PATH_INFO: `/v3/projects/648164531b8c4f07aa1abeb8b3526e0d` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.668516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] RBAC: Authorizing `identity:delete_project(project_id=648164531b8c4f07aa1abeb8b3526e0d)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.670527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.815003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648164531b8c4f07aa1abeb8b3526e0d', 'request_id': 'req-3e9a1cc8-1b00-4106-a386-6bad44a3388b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.816296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c319cc3163a4478f86299d9c59ca6eeb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.895329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648164531b8c4f07aa1abeb8b3526e0d', 'request_id': 'req-3e9a1cc8-1b00-4106-a386-6bad44a3388b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.902445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648164531b8c4f07aa1abeb8b3526e0d', 'request_id': 'req-3e9a1cc8-1b00-4106-a386-6bad44a3388b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.915694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] The token cache is being invalidate because project 648164531b8c4f07aa1abeb8b3526e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:13.916261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.917377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e9a1cc8-1b00-4106-a386-6bad44a3388b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.920196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1001/1976] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:13 2022] DELETE /identity/v3/projects/648164531b8c4f07aa1abeb8b3526e0d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:13.927884 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97e5c3-48c8-4f09-845e-380d5a127f33 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.928173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97e5c3-48c8-4f09-845e-380d5a127f33 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.928456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97e5c3-48c8-4f09-845e-380d5a127f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.946591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ad97e5c3-48c8-4f09-845e-380d5a127f33 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:13.951745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ad97e5c3-48c8-4f09-845e-380d5a127f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:13.970757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c319cc3163a4478f86299d9c59ca6eeb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.971392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c319cc3163a4478f86299d9c59ca6eeb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.985513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c319cc3163a4478f86299d9c59ca6eeb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.986296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6e62794e-af92-4470-b4e9-103556ec0b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c319cc3163a4478f86299d9c59ca6eeb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:14.003205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 976/1977] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:13 2022] DELETE /identity/v3/users/c319cc3163a4478f86299d9c59ca6eeb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:14.017895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1002/1978] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:14.027306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e80da-29c7-40cf-8864-75f21c04e6c4 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.027705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e80da-29c7-40cf-8864-75f21c04e6c4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.028059 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e80da-29c7-40cf-8864-75f21c04e6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.048692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-381e80da-29c7-40cf-8864-75f21c04e6c4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:14.050022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-381e80da-29c7-40cf-8864-75f21c04e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:14.114092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 977/1979] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:14.118824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97e5c3-48c8-4f09-845e-380d5a127f33 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.129580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97e5c3-48c8-4f09-845e-380d5a127f33 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.134994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a9280-c75b-428c-84ea-338824cb0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.135673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a9280-c75b-428c-84ea-338824cb0d64 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.135962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a9280-c75b-428c-84ea-338824cb0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.136246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a9280-c75b-428c-84ea-338824cb0d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.136985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a9280-c75b-428c-84ea-338824cb0d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:14.137311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a9280-c75b-428c-84ea-338824cb0d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.139009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a9280-c75b-428c-84ea-338824cb0d64 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.152641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1003/1980] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:14.157229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e80da-29c7-40cf-8864-75f21c04e6c4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.167518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e80da-29c7-40cf-8864-75f21c04e6c4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.172559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eec547-6262-47a9-a690-3d803671b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.173622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eec547-6262-47a9-a690-3d803671b8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.173622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eec547-6262-47a9-a690-3d803671b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.173898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eec547-6262-47a9-a690-3d803671b8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.174708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eec547-6262-47a9-a690-3d803671b8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.176740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eec547-6262-47a9-a690-3d803671b8c5 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.291073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 978/1981] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:14 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:14.292202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a9280-c75b-428c-84ea-338824cb0d64 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.303152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a9280-c75b-428c-84ea-338824cb0d64 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.363138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636794e5-f593-498b-a123-58e862bd80e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.363808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636794e5-f593-498b-a123-58e862bd80e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.364102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636794e5-f593-498b-a123-58e862bd80e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.364385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636794e5-f593-498b-a123-58e862bd80e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.365144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636794e5-f593-498b-a123-58e862bd80e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.367328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636794e5-f593-498b-a123-58e862bd80e7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.434190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1004/1982] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:14 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:14.438794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eec547-6262-47a9-a690-3d803671b8c5 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.450228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eec547-6262-47a9-a690-3d803671b8c5 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.455850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88262811-7e2a-4113-a10c-eefbf89966a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.458017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88262811-7e2a-4113-a10c-eefbf89966a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.458017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88262811-7e2a-4113-a10c-eefbf89966a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.458017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88262811-7e2a-4113-a10c-eefbf89966a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.458565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88262811-7e2a-4113-a10c-eefbf89966a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.460226 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88262811-7e2a-4113-a10c-eefbf89966a1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.471667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 979/1983] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:14.476017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636794e5-f593-498b-a123-58e862bd80e7 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.485687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:14.488430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636794e5-f593-498b-a123-58e862bd80e7 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.493419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563f94a-30a6-4ebf-9543-ac036b4a9678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.494128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f94a-30a6-4ebf-9543-ac036b4a9678 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.494418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f94a-30a6-4ebf-9543-ac036b4a9678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.494700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f94a-30a6-4ebf-9543-ac036b4a9678 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.495490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563f94a-30a6-4ebf-9543-ac036b4a9678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.497164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563f94a-30a6-4ebf-9543-ac036b4a9678 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.508923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1005/1984] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:14.513021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88262811-7e2a-4113-a10c-eefbf89966a1 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.524392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88262811-7e2a-4113-a10c-eefbf89966a1 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.531235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33153ef-cb52-42c0-bfab-15195f0ff0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.532879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33153ef-cb52-42c0-bfab-15195f0ff0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.533438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33153ef-cb52-42c0-bfab-15195f0ff0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.534040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33153ef-cb52-42c0-bfab-15195f0ff0e9 admin admin] PATH_INFO: `/v3/projects/3a427e1011dc4bfabcdcfc17820a6493/users/3b723446f6ea49609a45378f6f8277e9/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.552718 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33153ef-cb52-42c0-bfab-15195f0ff0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a427e1011dc4bfabcdcfc17820a6493, user_id=3b723446f6ea49609a45378f6f8277e9, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.555446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33153ef-cb52-42c0-bfab-15195f0ff0e9 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.588238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:14.622233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 980/1985] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:14 2022] PUT /identity/v3/projects/3a427e1011dc4bfabcdcfc17820a6493/users/3b723446f6ea49609a45378f6f8277e9/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:14.630124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8b48-77d0-4186-a11a-55bd06874cc6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.630634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8b48-77d0-4186-a11a-55bd06874cc6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.631068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8b48-77d0-4186-a11a-55bd06874cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.661214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b56f8b48-77d0-4186-a11a-55bd06874cc6 None None] MFA Rules not processed for user `3b723446f6ea49609a45378f6f8277e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:14.662403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b56f8b48-77d0-4186-a11a-55bd06874cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:14.745110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1006/1986] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:14.757478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33153ef-cb52-42c0-bfab-15195f0ff0e9 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.766525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e33153ef-cb52-42c0-bfab-15195f0ff0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:14.819736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33153ef-cb52-42c0-bfab-15195f0ff0e9 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.823396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81825480-74e4-4e30-9e2b-38ea9f84c6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.824047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81825480-74e4-4e30-9e2b-38ea9f84c6bf service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.824334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81825480-74e4-4e30-9e2b-38ea9f84c6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.824611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81825480-74e4-4e30-9e2b-38ea9f84c6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.833481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81825480-74e4-4e30-9e2b-38ea9f84c6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.834943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81825480-74e4-4e30-9e2b-38ea9f84c6bf service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.845915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 981/1987] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:14.847099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f8b48-77d0-4186-a11a-55bd06874cc6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.849218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b56f8b48-77d0-4186-a11a-55bd06874cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:14.984487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f8b48-77d0-4186-a11a-55bd06874cc6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.992796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.993902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.994563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.995035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] PATH_INFO: `/v3/projects/351d34f1a435409abe1c04098da46376` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.997893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351d34f1a435409abe1c04098da46376)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:15.002337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:15.031572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:15.146327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351d34f1a435409abe1c04098da46376', 'request_id': 'req-c7227616-7535-4266-9894-2591b3afd965'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:15.222159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351d34f1a435409abe1c04098da46376', 'request_id': 'req-c7227616-7535-4266-9894-2591b3afd965'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:15.229767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351d34f1a435409abe1c04098da46376', 'request_id': 'req-c7227616-7535-4266-9894-2591b3afd965'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:15.240352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] The token cache is being invalidate because project 351d34f1a435409abe1c04098da46376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:15.240621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:15.241324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7227616-7535-4266-9894-2591b3afd965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:15.242915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1007/1988] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:14 2022] DELETE /identity/v3/projects/351d34f1a435409abe1c04098da46376 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:15.248863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934ed5-b0c4-4e0f-9270-0eaaf3193e3d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:15.249160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934ed5-b0c4-4e0f-9270-0eaaf3193e3d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:15.249465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934ed5-b0c4-4e0f-9270-0eaaf3193e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:15.268357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a1934ed5-b0c4-4e0f-9270-0eaaf3193e3d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:15.269571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a1934ed5-b0c4-4e0f-9270-0eaaf3193e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:15.330667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 982/1989] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:15.340822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94857ff-7064-47ac-96cb-98f3928076f2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:15.341056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94857ff-7064-47ac-96cb-98f3928076f2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:15.341341 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94857ff-7064-47ac-96cb-98f3928076f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:15.359601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-e94857ff-7064-47ac-96cb-98f3928076f2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:15.360808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e94857ff-7064-47ac-96cb-98f3928076f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:15.372517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1008/1990] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:15.375955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934ed5-b0c4-4e0f-9270-0eaaf3193e3d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:15.387153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934ed5-b0c4-4e0f-9270-0eaaf3193e3d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:15.391939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54df6d-9621-49af-b15c-9e8f7d99c272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:15.392607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54df6d-9621-49af-b15c-9e8f7d99c272 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:15.392890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54df6d-9621-49af-b15c-9e8f7d99c272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:15.393165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54df6d-9621-49af-b15c-9e8f7d99c272 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:15.393920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54df6d-9621-49af-b15c-9e8f7d99c272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:15.394252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54df6d-9621-49af-b15c-9e8f7d99c272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:15.396412 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54df6d-9621-49af-b15c-9e8f7d99c272 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:15.411312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 983/1991] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:15.415672 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94857ff-7064-47ac-96cb-98f3928076f2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:15.425799 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94857ff-7064-47ac-96cb-98f3928076f2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:15.431507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95443229-dcd7-4194-9924-86b17fec3182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:15.432180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443229-dcd7-4194-9924-86b17fec3182 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:15.432509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443229-dcd7-4194-9924-86b17fec3182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:15.432943 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443229-dcd7-4194-9924-86b17fec3182 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:15.443954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95443229-dcd7-4194-9924-86b17fec3182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:15.448905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95443229-dcd7-4194-9924-86b17fec3182 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:15.537345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:15.552977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1009/1992] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:15 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:15.555078 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54df6d-9621-49af-b15c-9e8f7d99c272 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:15.571993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54df6d-9621-49af-b15c-9e8f7d99c272 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:15.634111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:15.661244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4829ae-9d49-4663-b476-27b586fc3851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:15.662110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4829ae-9d49-4663-b476-27b586fc3851 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:15.662519 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4829ae-9d49-4663-b476-27b586fc3851 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:15.662877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4829ae-9d49-4663-b476-27b586fc3851 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:15.663834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4829ae-9d49-4663-b476-27b586fc3851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:15.666348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4829ae-9d49-4663-b476-27b586fc3851 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:15.731931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 984/1993] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:15 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:15.735956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95443229-dcd7-4194-9924-86b17fec3182 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:15.747771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95443229-dcd7-4194-9924-86b17fec3182 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:15.753380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cec6fb-0c3c-4557-adf6-319599f452c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:15.754804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cec6fb-0c3c-4557-adf6-319599f452c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:15.755093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cec6fb-0c3c-4557-adf6-319599f452c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:15.755369 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cec6fb-0c3c-4557-adf6-319599f452c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:15.756225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cec6fb-0c3c-4557-adf6-319599f452c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:15.757795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cec6fb-0c3c-4557-adf6-319599f452c2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:15.769991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1010/1994] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:15.772646 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4829ae-9d49-4663-b476-27b586fc3851 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:15.786320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4829ae-9d49-4663-b476-27b586fc3851 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:15.792660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7477e-5c3b-42ab-ae15-9de175bf5d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:15.793569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7477e-5c3b-42ab-ae15-9de175bf5d9b admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:15.794205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7477e-5c3b-42ab-ae15-9de175bf5d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:15.794654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7477e-5c3b-42ab-ae15-9de175bf5d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:15.799354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7477e-5c3b-42ab-ae15-9de175bf5d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:15.799354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7477e-5c3b-42ab-ae15-9de175bf5d9b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:15.812932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 985/1995] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:15.817643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cec6fb-0c3c-4557-adf6-319599f452c2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:15.832813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cec6fb-0c3c-4557-adf6-319599f452c2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:15.847011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5cdac-c949-4aaf-aadc-c0d475e6fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:15.847972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cdac-c949-4aaf-aadc-c0d475e6fe2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:15.848315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cdac-c949-4aaf-aadc-c0d475e6fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:15.849379 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cdac-c949-4aaf-aadc-c0d475e6fe2f admin admin] PATH_INFO: `/v3/projects/f54bc2e94a2b46fbace5f5745bc15cdd/users/b7352f61af2241b0babedb2000f7de17/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:15.888420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5cdac-c949-4aaf-aadc-c0d475e6fe2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54bc2e94a2b46fbace5f5745bc15cdd, user_id=b7352f61af2241b0babedb2000f7de17, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:15.897473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5cdac-c949-4aaf-aadc-c0d475e6fe2f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:15.953081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1011/1996] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:15 2022] PUT /identity/v3/projects/f54bc2e94a2b46fbace5f5745bc15cdd/users/b7352f61af2241b0babedb2000f7de17/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:15.955527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d544-2029-4678-929a-dfcefc0ad8be None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:15.955904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d544-2029-4678-929a-dfcefc0ad8be None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:15.956472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d544-2029-4678-929a-dfcefc0ad8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:15.977665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3224d544-2029-4678-929a-dfcefc0ad8be None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:15.981564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3224d544-2029-4678-929a-dfcefc0ad8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:16.046430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:16.049003 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 986/1997] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:16.059425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5cdac-c949-4aaf-aadc-c0d475e6fe2f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:16.061199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-bca5cdac-c949-4aaf-aadc-c0d475e6fe2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:16.097226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:16.125847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5cdac-c949-4aaf-aadc-c0d475e6fe2f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:16.129779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20aa64-59f7-4e00-9c04-0d8bd7d19c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:16.130526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20aa64-59f7-4e00-9c04-0d8bd7d19c72 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:16.130818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20aa64-59f7-4e00-9c04-0d8bd7d19c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:16.131098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20aa64-59f7-4e00-9c04-0d8bd7d19c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:16.140628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20aa64-59f7-4e00-9c04-0d8bd7d19c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:16.142136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20aa64-59f7-4e00-9c04-0d8bd7d19c72 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:16.153135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1012/1998] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:16.165274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:16.404990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:16.754600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:16.970918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:17.472954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e688596-0020-4810-9ce2-3907de8e0c68 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.473521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e688596-0020-4810-9ce2-3907de8e0c68 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.474048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e688596-0020-4810-9ce2-3907de8e0c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.502195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6e688596-0020-4810-9ce2-3907de8e0c68 None None] MFA Rules not processed for user `b7352f61af2241b0babedb2000f7de17`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:17.503493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6e688596-0020-4810-9ce2-3907de8e0c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:17.569748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 987/1999] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:17.587244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20aa64-59f7-4e00-9c04-0d8bd7d19c72 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:17.589031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0d20aa64-59f7-4e00-9c04-0d8bd7d19c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:17.655775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20aa64-59f7-4e00-9c04-0d8bd7d19c72 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:17.659767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21deae65-3362-488a-bd0c-a6429f0db908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:17.660635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deae65-3362-488a-bd0c-a6429f0db908 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.661151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deae65-3362-488a-bd0c-a6429f0db908 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.661601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deae65-3362-488a-bd0c-a6429f0db908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.670815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21deae65-3362-488a-bd0c-a6429f0db908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:17.672344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21deae65-3362-488a-bd0c-a6429f0db908 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:17.682960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1013/2000] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:17.780975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:17.965677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:18.015668 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226bdb0-1769-431e-a9f7-f3fbfc6d62ce None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.016169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226bdb0-1769-431e-a9f7-f3fbfc6d62ce None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.016289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226bdb0-1769-431e-a9f7-f3fbfc6d62ce None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.017628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 988/2001] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:52:18.024912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3208d-938e-4aa0-91ba-150fd5bc14c8 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.025207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3208d-938e-4aa0-91ba-150fd5bc14c8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.025487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3208d-938e-4aa0-91ba-150fd5bc14c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.044306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-16f3208d-938e-4aa0-91ba-150fd5bc14c8 None None] MFA Rules not processed for user `3238a52a3f6047e0acb0136ab39257e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:18.046251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-16f3208d-938e-4aa0-91ba-150fd5bc14c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:18.131064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1014/2002] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:18.142677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226bdb0-1769-431e-a9f7-f3fbfc6d62ce None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.144363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a226bdb0-1769-431e-a9f7-f3fbfc6d62ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:18.161111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226bdb0-1769-431e-a9f7-f3fbfc6d62ce None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.167695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9533b2c-aca7-4097-b4ab-49bedf09e479 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3238a52a3f6047e0acb0136ab39257e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.168547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9533b2c-aca7-4097-b4ab-49bedf09e479 service placement] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.168838 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9533b2c-aca7-4097-b4ab-49bedf09e479 service placement] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.169120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9533b2c-aca7-4097-b4ab-49bedf09e479 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.183985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9533b2c-aca7-4097-b4ab-49bedf09e479 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.183985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9533b2c-aca7-4097-b4ab-49bedf09e479 service placement] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.193762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 989/2003] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:18.212822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3208d-938e-4aa0-91ba-150fd5bc14c8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.214760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-16f3208d-938e-4aa0-91ba-150fd5bc14c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:18.233120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3208d-938e-4aa0-91ba-150fd5bc14c8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.241113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.243060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.243284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.243726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] PATH_INFO: `/v3/users/f38293b202a4451bb577b28727d986fe` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.245007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38293b202a4451bb577b28727d986fe)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.247007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.445588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38293b202a4451bb577b28727d986fe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:18.541655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38293b202a4451bb577b28727d986fe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:18.559263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38293b202a4451bb577b28727d986fe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:18.560198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38293b202a4451bb577b28727d986fe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:18.570509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e332db67-162d-48bf-983d-d055db6e67df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38293b202a4451bb577b28727d986fe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:18.579506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1015/2004] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:18 2022] DELETE /identity/v3/users/f38293b202a4451bb577b28727d986fe => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:18.857889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9533b2c-aca7-4097-b4ab-49bedf09e479 service placement] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.869692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9533b2c-aca7-4097-b4ab-49bedf09e479 service placement] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.960060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.960930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.961217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.961502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] PATH_INFO: `/v3/projects/9b08e734c7b543e3a6c3150d8ba3dda2` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.962733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b08e734c7b543e3a6c3150d8ba3dda2)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.964951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:19.062882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b08e734c7b543e3a6c3150d8ba3dda2', 'request_id': 'req-562e9e4e-1935-43be-b1bc-f42e038c297a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:19.069070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b08e734c7b543e3a6c3150d8ba3dda2', 'request_id': 'req-562e9e4e-1935-43be-b1bc-f42e038c297a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:19.135564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b08e734c7b543e3a6c3150d8ba3dda2', 'request_id': 'req-562e9e4e-1935-43be-b1bc-f42e038c297a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:19.147727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] The token cache is being invalidate because project 9b08e734c7b543e3a6c3150d8ba3dda2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:19.147727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:19.148359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-562e9e4e-1935-43be-b1bc-f42e038c297a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:19.149918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 990/2005] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:18 2022] DELETE /identity/v3/projects/9b08e734c7b543e3a6c3150d8ba3dda2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:19.154753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe515d1-6900-4792-87e9-6f031605749a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.155184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe515d1-6900-4792-87e9-6f031605749a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.155470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe515d1-6900-4792-87e9-6f031605749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.175234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4fe515d1-6900-4792-87e9-6f031605749a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:19.177238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4fe515d1-6900-4792-87e9-6f031605749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:19.237598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1016/2006] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:19.246900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847a701-be3e-46ad-b491-8aad69b1ab5d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.247287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847a701-be3e-46ad-b491-8aad69b1ab5d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.247570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847a701-be3e-46ad-b491-8aad69b1ab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.265836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c847a701-be3e-46ad-b491-8aad69b1ab5d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:19.267144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c847a701-be3e-46ad-b491-8aad69b1ab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:19.277188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 991/2007] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:19.280809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe515d1-6900-4792-87e9-6f031605749a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:19.291267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe515d1-6900-4792-87e9-6f031605749a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:19.295971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826e2e4-6122-4391-acbe-4e77c647c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:19.296718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826e2e4-6122-4391-acbe-4e77c647c4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.297005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826e2e4-6122-4391-acbe-4e77c647c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.297282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826e2e4-6122-4391-acbe-4e77c647c4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.298071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826e2e4-6122-4391-acbe-4e77c647c4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:19.298429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826e2e4-6122-4391-acbe-4e77c647c4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:19.300277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826e2e4-6122-4391-acbe-4e77c647c4f9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:19.313632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1017/2008] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:19.317894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847a701-be3e-46ad-b491-8aad69b1ab5d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:19.327363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847a701-be3e-46ad-b491-8aad69b1ab5d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:19.332633 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68c648-9c41-4572-b703-397512c1d0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:19.334619 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68c648-9c41-4572-b703-397512c1d0de admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.334619 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68c648-9c41-4572-b703-397512c1d0de admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.334619 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68c648-9c41-4572-b703-397512c1d0de admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.334619 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68c648-9c41-4572-b703-397512c1d0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:19.336469 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68c648-9c41-4572-b703-397512c1d0de admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:19.465097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 992/2009] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:19 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:19.469041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826e2e4-6122-4391-acbe-4e77c647c4f9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:19.479839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826e2e4-6122-4391-acbe-4e77c647c4f9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:19.540441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cadd8f-02ed-4007-b4ce-38fb1c15de6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:19.541051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cadd8f-02ed-4007-b4ce-38fb1c15de6e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.546507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cadd8f-02ed-4007-b4ce-38fb1c15de6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.546507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cadd8f-02ed-4007-b4ce-38fb1c15de6e admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.546507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cadd8f-02ed-4007-b4ce-38fb1c15de6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:19.546924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:19.547021 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cadd8f-02ed-4007-b4ce-38fb1c15de6e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:19.591609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409247a-4972-408f-8a27-5c143b791176 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.591941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409247a-4972-408f-8a27-5c143b791176 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.592417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409247a-4972-408f-8a27-5c143b791176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.602528 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1018/2010] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:19 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:19.606613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cadd8f-02ed-4007-b4ce-38fb1c15de6e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:19.612246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9409247a-4972-408f-8a27-5c143b791176 None None] MFA Rules not processed for user `b7352f61af2241b0babedb2000f7de17`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:19.613506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9409247a-4972-408f-8a27-5c143b791176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:19.617090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cadd8f-02ed-4007-b4ce-38fb1c15de6e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:19.624544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4781b7-673f-4d73-8842-a35983fd9606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:19.625217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4781b7-673f-4d73-8842-a35983fd9606 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.625502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4781b7-673f-4d73-8842-a35983fd9606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.625775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4781b7-673f-4d73-8842-a35983fd9606 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.626549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4781b7-673f-4d73-8842-a35983fd9606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:19.628566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4781b7-673f-4d73-8842-a35983fd9606 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:19.638782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1019/2011] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:19.642480 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4781b7-673f-4d73-8842-a35983fd9606 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:19.653140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4781b7-673f-4d73-8842-a35983fd9606 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:19.659440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005c971-e29c-4fdb-9994-7d1081b02986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:19.660747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005c971-e29c-4fdb-9994-7d1081b02986 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.661206 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005c971-e29c-4fdb-9994-7d1081b02986 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.661487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005c971-e29c-4fdb-9994-7d1081b02986 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.662288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005c971-e29c-4fdb-9994-7d1081b02986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:19.663903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005c971-e29c-4fdb-9994-7d1081b02986 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:19.675400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1020/2012] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:19.678964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 993/2013] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:19.683246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005c971-e29c-4fdb-9994-7d1081b02986 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:19.703898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005c971-e29c-4fdb-9994-7d1081b02986 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:19.714082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b327-7350-42e8-aa7a-105d7d2588f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:19.714082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b327-7350-42e8-aa7a-105d7d2588f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.714082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b327-7350-42e8-aa7a-105d7d2588f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.714082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b327-7350-42e8-aa7a-105d7d2588f8 admin admin] PATH_INFO: `/v3/projects/35fa9974b88d4ae1a41b311aeaa56d84/users/d552d602c04b4413a1b36681f580f802/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.726643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3b327-7350-42e8-aa7a-105d7d2588f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fa9974b88d4ae1a41b311aeaa56d84, user_id=d552d602c04b4413a1b36681f580f802, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:19.729309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3b327-7350-42e8-aa7a-105d7d2588f8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:19.851275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1021/2014] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:19 2022] PUT /identity/v3/projects/35fa9974b88d4ae1a41b311aeaa56d84/users/d552d602c04b4413a1b36681f580f802/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:19.861854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e9d10-34d0-42a7-bb30-0405154d5dfa None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:19.862201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e9d10-34d0-42a7-bb30-0405154d5dfa None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:19.862795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e9d10-34d0-42a7-bb30-0405154d5dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:19.874102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:19.916872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ec7e9d10-34d0-42a7-bb30-0405154d5dfa None None] MFA Rules not processed for user `d552d602c04b4413a1b36681f580f802`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:19.916872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ec7e9d10-34d0-42a7-bb30-0405154d5dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:19.991706 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 994/2015] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:20.003316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b327-7350-42e8-aa7a-105d7d2588f8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:20.005713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cce3b327-7350-42e8-aa7a-105d7d2588f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:20.071490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b327-7350-42e8-aa7a-105d7d2588f8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:20.075445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4081f1-f9af-4d72-8619-97a60fadb020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:20.076126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4081f1-f9af-4d72-8619-97a60fadb020 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:20.076432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4081f1-f9af-4d72-8619-97a60fadb020 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:20.076709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4081f1-f9af-4d72-8619-97a60fadb020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:20.085523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4081f1-f9af-4d72-8619-97a60fadb020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:20.087077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4081f1-f9af-4d72-8619-97a60fadb020 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:20.097212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1022/2016] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:20.627662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:20.851078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:21.238748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:22.014317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:22.102588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:22.252550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e9d10-34d0-42a7-bb30-0405154d5dfa None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:22.254671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ec7e9d10-34d0-42a7-bb30-0405154d5dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:22.328316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e9d10-34d0-42a7-bb30-0405154d5dfa None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:22.333423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:22.334332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:22.334622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:22.334901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] PATH_INFO: `/v3/users/3b723446f6ea49609a45378f6f8277e9` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:22.336095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b723446f6ea49609a45378f6f8277e9)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:22.338055 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:22.492953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b723446f6ea49609a45378f6f8277e9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.564489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b723446f6ea49609a45378f6f8277e9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.565118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b723446f6ea49609a45378f6f8277e9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.579014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b723446f6ea49609a45378f6f8277e9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.579683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b723446f6ea49609a45378f6f8277e9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.593436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 995/2017] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:22 2022] DELETE /identity/v3/users/3b723446f6ea49609a45378f6f8277e9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:22.598499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465247b9-48be-4eb0-9b9e-8c9f0bbfd37a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:22.598990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465247b9-48be-4eb0-9b9e-8c9f0bbfd37a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:22.599492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465247b9-48be-4eb0-9b9e-8c9f0bbfd37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:22.618242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-465247b9-48be-4eb0-9b9e-8c9f0bbfd37a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:22.619430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-465247b9-48be-4eb0-9b9e-8c9f0bbfd37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:22.682375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1023/2018] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:22.692316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:22.693701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:22.764346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a8f2d-05fd-4272-94f2-1d887bb6b57b admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:22.768009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee46c7-4297-4a55-9fbd-f357a4bbb9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:22.768662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee46c7-4297-4a55-9fbd-f357a4bbb9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:22.768951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee46c7-4297-4a55-9fbd-f357a4bbb9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:22.769228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee46c7-4297-4a55-9fbd-f357a4bbb9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:22.778766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee46c7-4297-4a55-9fbd-f357a4bbb9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:22.780230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee46c7-4297-4a55-9fbd-f357a4bbb9a0 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:22.789977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 996/2019] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:22.947682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:22.988573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465247b9-48be-4eb0-9b9e-8c9f0bbfd37a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:22.990129 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-465247b9-48be-4eb0-9b9e-8c9f0bbfd37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:23.002099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465247b9-48be-4eb0-9b9e-8c9f0bbfd37a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:23.007988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:23.008555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.012488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.012488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] PATH_INFO: `/v3/users/c4dba785eba04aa99014859bc0f967b0` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.012488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4dba785eba04aa99014859bc0f967b0)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:23.012488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:23.027910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:23.242501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4dba785eba04aa99014859bc0f967b0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.286903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee46c7-4297-4a55-9fbd-f357a4bbb9a0 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:23.288937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-0bee46c7-4297-4a55-9fbd-f357a4bbb9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:23.301675 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4dba785eba04aa99014859bc0f967b0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.315965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee46c7-4297-4a55-9fbd-f357a4bbb9a0 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:23.315965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:23.315965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.315965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.316639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] PATH_INFO: `/v3/projects/3a427e1011dc4bfabcdcfc17820a6493` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.316639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a427e1011dc4bfabcdcfc17820a6493)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:23.316639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:23.318232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4dba785eba04aa99014859bc0f967b0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.319049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4dba785eba04aa99014859bc0f967b0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.327451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7729dbdd-16dc-40b2-9624-594c13a4b41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4dba785eba04aa99014859bc0f967b0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.334908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1024/2020] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:22 2022] DELETE /identity/v3/users/c4dba785eba04aa99014859bc0f967b0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:23.339456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c80fdf-e100-4b94-98cc-d127383de498 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.339953 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c80fdf-e100-4b94-98cc-d127383de498 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.340689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c80fdf-e100-4b94-98cc-d127383de498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.358751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-57c80fdf-e100-4b94-98cc-d127383de498 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:23.360134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-57c80fdf-e100-4b94-98cc-d127383de498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:23.420727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1025/2021] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:23.431582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c80fdf-e100-4b94-98cc-d127383de498 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:23.433132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-57c80fdf-e100-4b94-98cc-d127383de498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:23.447154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a427e1011dc4bfabcdcfc17820a6493', 'request_id': 'req-9efc009e-9748-4777-8518-ad28e78c7f71'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.453779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a427e1011dc4bfabcdcfc17820a6493', 'request_id': 'req-9efc009e-9748-4777-8518-ad28e78c7f71'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.502340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c80fdf-e100-4b94-98cc-d127383de498 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:23.542308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a427e1011dc4bfabcdcfc17820a6493', 'request_id': 'req-9efc009e-9748-4777-8518-ad28e78c7f71'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.553378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52fcca-ad35-472e-b725-9bbb8d966ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:23.553888 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] The token cache is being invalidate because project 3a427e1011dc4bfabcdcfc17820a6493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:23.554101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52fcca-ad35-472e-b725-9bbb8d966ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.554246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.554348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52fcca-ad35-472e-b725-9bbb8d966ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.554618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52fcca-ad35-472e-b725-9bbb8d966ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.554917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9efc009e-9748-4777-8518-ad28e78c7f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.556595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 997/2022] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:23 2022] DELETE /identity/v3/projects/3a427e1011dc4bfabcdcfc17820a6493 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:23.561535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aaab4-602d-427a-8359-c0665d0790b0 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.561835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aaab4-602d-427a-8359-c0665d0790b0 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.562277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aaab4-602d-427a-8359-c0665d0790b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.584709 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-213aaab4-602d-427a-8359-c0665d0790b0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:23.586185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-213aaab4-602d-427a-8359-c0665d0790b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:23.620222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52fcca-ad35-472e-b725-9bbb8d966ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:23.621584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52fcca-ad35-472e-b725-9bbb8d966ea9 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:23.631932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1026/2023] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:23.648764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 998/2024] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:23.658633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f906703-4ec4-4f3c-b530-03e394c66b40 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.658925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f906703-4ec4-4f3c-b530-03e394c66b40 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.659385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f906703-4ec4-4f3c-b530-03e394c66b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.679904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-8f906703-4ec4-4f3c-b530-03e394c66b40 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:23.681436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8f906703-4ec4-4f3c-b530-03e394c66b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:23.698501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1027/2025] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:23.699820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aaab4-602d-427a-8359-c0665d0790b0 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:23.715439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aaab4-602d-427a-8359-c0665d0790b0 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:23.733533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e278b-ca07-4d05-bd49-62ad00e77f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:23.733533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e278b-ca07-4d05-bd49-62ad00e77f98 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.733533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e278b-ca07-4d05-bd49-62ad00e77f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.733533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e278b-ca07-4d05-bd49-62ad00e77f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.733922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e278b-ca07-4d05-bd49-62ad00e77f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:23.733922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e278b-ca07-4d05-bd49-62ad00e77f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:23.733922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e278b-ca07-4d05-bd49-62ad00e77f98 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:23.749691 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 999/2026] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:23.754791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f906703-4ec4-4f3c-b530-03e394c66b40 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:23.764308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f906703-4ec4-4f3c-b530-03e394c66b40 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:23.769877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e6bcf-0ce3-4f1d-814d-4386fddc182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:23.770866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e6bcf-0ce3-4f1d-814d-4386fddc182c admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.771280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e6bcf-0ce3-4f1d-814d-4386fddc182c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.771776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e6bcf-0ce3-4f1d-814d-4386fddc182c admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.772654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e6bcf-0ce3-4f1d-814d-4386fddc182c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:23.774849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e6bcf-0ce3-4f1d-814d-4386fddc182c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:23.909482 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1028/2027] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:23 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:23.914056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e278b-ca07-4d05-bd49-62ad00e77f98 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:23.926232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e278b-ca07-4d05-bd49-62ad00e77f98 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.006858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940304d-f966-499f-9310-4a8b9571b988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.007546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940304d-f966-499f-9310-4a8b9571b988 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.007982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940304d-f966-499f-9310-4a8b9571b988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.008274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940304d-f966-499f-9310-4a8b9571b988 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.009093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940304d-f966-499f-9310-4a8b9571b988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.011265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940304d-f966-499f-9310-4a8b9571b988 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.113791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1000/2028] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:23 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:24.118859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e6bcf-0ce3-4f1d-814d-4386fddc182c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.129990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e6bcf-0ce3-4f1d-814d-4386fddc182c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.134407 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17fecd-4a0b-48dc-859f-ad24f3610784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.135074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17fecd-4a0b-48dc-859f-ad24f3610784 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.135361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17fecd-4a0b-48dc-859f-ad24f3610784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.135632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17fecd-4a0b-48dc-859f-ad24f3610784 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.136370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17fecd-4a0b-48dc-859f-ad24f3610784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.138016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17fecd-4a0b-48dc-859f-ad24f3610784 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.151885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1029/2029] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:24.161700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940304d-f966-499f-9310-4a8b9571b988 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.164154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17fecd-4a0b-48dc-859f-ad24f3610784 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.166189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8e17fecd-4a0b-48dc-859f-ad24f3610784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:24.173397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940304d-f966-499f-9310-4a8b9571b988 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.185086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17fecd-4a0b-48dc-859f-ad24f3610784 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.189666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8130d23-94a1-4299-a546-c5175d387dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.191402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8130d23-94a1-4299-a546-c5175d387dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.192323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8130d23-94a1-4299-a546-c5175d387dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.193282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8130d23-94a1-4299-a546-c5175d387dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.194338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8130d23-94a1-4299-a546-c5175d387dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.200615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8130d23-94a1-4299-a546-c5175d387dd1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.200734 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.202491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.202680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.202972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] PATH_INFO: `/v3/projects/53f13414a52a4af69df23335ba5a1640` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.204923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f13414a52a4af69df23335ba5a1640)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.207086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.215680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1001/2030] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:24.219643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8130d23-94a1-4299-a546-c5175d387dd1 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.230886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8130d23-94a1-4299-a546-c5175d387dd1 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.235854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f46dcb-0531-48cb-9263-9378cc09a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.236862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f46dcb-0531-48cb-9263-9378cc09a95c admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.237264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f46dcb-0531-48cb-9263-9378cc09a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.237674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f46dcb-0531-48cb-9263-9378cc09a95c admin admin] PATH_INFO: `/v3/projects/a2a40dd9c93c4c34862401e4e6fa4e6e/users/20286d268ba74a979a60be27fbad792b/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.253868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f46dcb-0531-48cb-9263-9378cc09a95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a40dd9c93c4c34862401e4e6fa4e6e, user_id=20286d268ba74a979a60be27fbad792b, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.256600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f46dcb-0531-48cb-9263-9378cc09a95c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.290550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:24.401029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:24.411524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1002/2031] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:24 2022] PUT /identity/v3/projects/a2a40dd9c93c4c34862401e4e6fa4e6e/users/20286d268ba74a979a60be27fbad792b/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:24.413838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f13414a52a4af69df23335ba5a1640', 'request_id': 'req-83adb3f3-a24a-4e4d-990d-e38b6184e30f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:24.422563 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caff74-e106-4420-887b-4a5bdd5baa3c None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.422932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caff74-e106-4420-887b-4a5bdd5baa3c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.423291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caff74-e106-4420-887b-4a5bdd5baa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.455076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-31caff74-e106-4420-887b-4a5bdd5baa3c None None] MFA Rules not processed for user `20286d268ba74a979a60be27fbad792b`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:24.455076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-31caff74-e106-4420-887b-4a5bdd5baa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:24.519126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f13414a52a4af69df23335ba5a1640', 'request_id': 'req-83adb3f3-a24a-4e4d-990d-e38b6184e30f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:24.526962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1003/2032] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:24.531287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31caff74-e106-4420-887b-4a5bdd5baa3c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.538681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f13414a52a4af69df23335ba5a1640', 'request_id': 'req-83adb3f3-a24a-4e4d-990d-e38b6184e30f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:24.551618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] The token cache is being invalidate because project 53f13414a52a4af69df23335ba5a1640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:24.551862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:24.552697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-83adb3f3-a24a-4e4d-990d-e38b6184e30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:24.554318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1030/2033] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:24 2022] DELETE /identity/v3/projects/53f13414a52a4af69df23335ba5a1640 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:24.559187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0361-b667-4933-9acf-76a054c1f52a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.559547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0361-b667-4933-9acf-76a054c1f52a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.559921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0361-b667-4933-9acf-76a054c1f52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.580659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4a8d0361-b667-4933-9acf-76a054c1f52a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:24.583433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4a8d0361-b667-4933-9acf-76a054c1f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:24.648489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31caff74-e106-4420-887b-4a5bdd5baa3c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.654612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab01256-6f88-4344-a1c1-e9b689458b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.655514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab01256-6f88-4344-a1c1-e9b689458b53 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.655640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1031/2034] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:24.662774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab01256-6f88-4344-a1c1-e9b689458b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.663095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab01256-6f88-4344-a1c1-e9b689458b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.663896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab01256-6f88-4344-a1c1-e9b689458b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.664515 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40652c6-ab7b-40ea-8874-03ad962e0938 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.664931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40652c6-ab7b-40ea-8874-03ad962e0938 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.665373 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40652c6-ab7b-40ea-8874-03ad962e0938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.667155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab01256-6f88-4344-a1c1-e9b689458b53 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.687502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d40652c6-ab7b-40ea-8874-03ad962e0938 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:24.692011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d40652c6-ab7b-40ea-8874-03ad962e0938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:24.700704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1032/2035] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:24.705088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40652c6-ab7b-40ea-8874-03ad962e0938 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.715689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40652c6-ab7b-40ea-8874-03ad962e0938 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.720553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eca2c-2cb7-4637-ba10-25e985ab1fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.721215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eca2c-2cb7-4637-ba10-25e985ab1fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.725252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eca2c-2cb7-4637-ba10-25e985ab1fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.725252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eca2c-2cb7-4637-ba10-25e985ab1fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.725252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eca2c-2cb7-4637-ba10-25e985ab1fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:24.725252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eca2c-2cb7-4637-ba10-25e985ab1fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.725252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eca2c-2cb7-4637-ba10-25e985ab1fb3 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.737253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1033/2036] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:52:24.741668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eca2c-2cb7-4637-ba10-25e985ab1fb3 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.754151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eca2c-2cb7-4637-ba10-25e985ab1fb3 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.759087 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7a63-d3df-4a05-8b7a-704a29d94574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.759829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7a63-d3df-4a05-8b7a-704a29d94574 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.760118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7a63-d3df-4a05-8b7a-704a29d94574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.760396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7a63-d3df-4a05-8b7a-704a29d94574 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.761089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af7a63-d3df-4a05-8b7a-704a29d94574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.763231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af7a63-d3df-4a05-8b7a-704a29d94574 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.778490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1004/2037] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:24.782415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab01256-6f88-4344-a1c1-e9b689458b53 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.784085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-fab01256-6f88-4344-a1c1-e9b689458b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:24.851754 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab01256-6f88-4344-a1c1-e9b689458b53 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.856667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4be79-3334-4673-99ed-1cec59a9cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.857345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4be79-3334-4673-99ed-1cec59a9cadf admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.857632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4be79-3334-4673-99ed-1cec59a9cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.857909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4be79-3334-4673-99ed-1cec59a9cadf admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.858625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4be79-3334-4673-99ed-1cec59a9cadf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.860590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4be79-3334-4673-99ed-1cec59a9cadf admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.868563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1034/2038] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:24.872846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7a63-d3df-4a05-8b7a-704a29d94574 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.947122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7a63-d3df-4a05-8b7a-704a29d94574 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.953050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6a0d-707c-4c4f-8bb2-406c2e04730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.954453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6a0d-707c-4c4f-8bb2-406c2e04730a admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.954788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6a0d-707c-4c4f-8bb2-406c2e04730a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.955071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6a0d-707c-4c4f-8bb2-406c2e04730a admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.955904 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf6a0d-707c-4c4f-8bb2-406c2e04730a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.958856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf6a0d-707c-4c4f-8bb2-406c2e04730a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.959537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1005/2039] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:24.963341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4be79-3334-4673-99ed-1cec59a9cadf admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.975501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4be79-3334-4673-99ed-1cec59a9cadf admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.980647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e9352-2fc5-4913-8484-c6ee64e6e6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.981147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e9352-2fc5-4913-8484-c6ee64e6e6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.981725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e9352-2fc5-4913-8484-c6ee64e6e6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.981725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e9352-2fc5-4913-8484-c6ee64e6e6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.983084 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e9352-2fc5-4913-8484-c6ee64e6e6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.984062 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e9352-2fc5-4913-8484-c6ee64e6e6f6 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.998430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1006/2040] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:24.999415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e9352-2fc5-4913-8484-c6ee64e6e6f6 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.010481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e9352-2fc5-4913-8484-c6ee64e6e6f6 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.016339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeae93a-83fb-441b-b738-fd15a715ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.017094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeae93a-83fb-441b-b738-fd15a715ff58 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.017460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeae93a-83fb-441b-b738-fd15a715ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.017806 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeae93a-83fb-441b-b738-fd15a715ff58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.018636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeae93a-83fb-441b-b738-fd15a715ff58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.020906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeae93a-83fb-441b-b738-fd15a715ff58 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.034001 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1007/2041] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:25.038128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeae93a-83fb-441b-b738-fd15a715ff58 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.049303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeae93a-83fb-441b-b738-fd15a715ff58 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.054430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b70976-2628-47fa-868f-c762d8dbe73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.055333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b70976-2628-47fa-868f-c762d8dbe73e admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.056235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b70976-2628-47fa-868f-c762d8dbe73e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.056675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b70976-2628-47fa-868f-c762d8dbe73e admin admin] PATH_INFO: `/v3/projects/c85fcd4094e54ab58a56331dc73648c9/users/c85094deb6de44a39bf3589d96398ba2/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.062807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1035/2042] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:25.067553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6a0d-707c-4c4f-8bb2-406c2e04730a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.075453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b70976-2628-47fa-868f-c762d8dbe73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85fcd4094e54ab58a56331dc73648c9, user_id=c85094deb6de44a39bf3589d96398ba2, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.078434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6a0d-707c-4c4f-8bb2-406c2e04730a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.079118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b70976-2628-47fa-868f-c762d8dbe73e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.084125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855012bf-f14c-49b4-ad14-8e1637baf02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.084790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855012bf-f14c-49b4-ad14-8e1637baf02f admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.085130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855012bf-f14c-49b4-ad14-8e1637baf02f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.085411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855012bf-f14c-49b4-ad14-8e1637baf02f admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.086188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855012bf-f14c-49b4-ad14-8e1637baf02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.088017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855012bf-f14c-49b4-ad14-8e1637baf02f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.100386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1036/2043] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:25.104318 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855012bf-f14c-49b4-ad14-8e1637baf02f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.114006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855012bf-f14c-49b4-ad14-8e1637baf02f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.118637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af2864-6501-4af2-98fe-7209e30f48d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.119273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af2864-6501-4af2-98fe-7209e30f48d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.119556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af2864-6501-4af2-98fe-7209e30f48d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.119835 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af2864-6501-4af2-98fe-7209e30f48d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.120545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af2864-6501-4af2-98fe-7209e30f48d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.122160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af2864-6501-4af2-98fe-7209e30f48d0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.133499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1037/2044] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:25.137477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af2864-6501-4af2-98fe-7209e30f48d0 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.147730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af2864-6501-4af2-98fe-7209e30f48d0 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.152436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662654f-e552-4e06-9f60-99301ca33c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.153359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662654f-e552-4e06-9f60-99301ca33c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.153672 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662654f-e552-4e06-9f60-99301ca33c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.153965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662654f-e552-4e06-9f60-99301ca33c9b admin admin] PATH_INFO: `/v3/projects/6fd77c4c59704957ae5acc5df8f1a262/users/47378065db004dd79e895aa7e8eba411/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.167356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1008/2045] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:25 2022] PUT /identity/v3/projects/c85fcd4094e54ab58a56331dc73648c9/users/c85094deb6de44a39bf3589d96398ba2/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:25.171891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662654f-e552-4e06-9f60-99301ca33c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd77c4c59704957ae5acc5df8f1a262, user_id=47378065db004dd79e895aa7e8eba411, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.174650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662654f-e552-4e06-9f60-99301ca33c9b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.178323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4508a2-87e7-4b59-bf38-0f2d21f11ea3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.178720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4508a2-87e7-4b59-bf38-0f2d21f11ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.179163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4508a2-87e7-4b59-bf38-0f2d21f11ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.206008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-bf4508a2-87e7-4b59-bf38-0f2d21f11ea3 None None] MFA Rules not processed for user `c85094deb6de44a39bf3589d96398ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:25.207963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bf4508a2-87e7-4b59-bf38-0f2d21f11ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:25.258326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1038/2046] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:25 2022] PUT /identity/v3/projects/6fd77c4c59704957ae5acc5df8f1a262/users/47378065db004dd79e895aa7e8eba411/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:25.268490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6a4c1-ea7f-4def-88a4-bf9a817cc83a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.268785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6a4c1-ea7f-4def-88a4-bf9a817cc83a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.269070 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6a4c1-ea7f-4def-88a4-bf9a817cc83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.275940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1009/2047] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:25.279986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4508a2-87e7-4b59-bf38-0f2d21f11ea3 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.301795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-77e6a4c1-ea7f-4def-88a4-bf9a817cc83a None None] MFA Rules not processed for user `47378065db004dd79e895aa7e8eba411`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:25.303136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-77e6a4c1-ea7f-4def-88a4-bf9a817cc83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:25.325225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:25.350680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4508a2-87e7-4b59-bf38-0f2d21f11ea3 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.369737 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:25.379980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1039/2048] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:25.388425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6a4c1-ea7f-4def-88a4-bf9a817cc83a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.389871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-77e6a4c1-ea7f-4def-88a4-bf9a817cc83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:25.417626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b331a-f2bf-4b45-81fe-b20ac3d6577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.418347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b331a-f2bf-4b45-81fe-b20ac3d6577e admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.418637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b331a-f2bf-4b45-81fe-b20ac3d6577e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.418918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b331a-f2bf-4b45-81fe-b20ac3d6577e admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.419616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b331a-f2bf-4b45-81fe-b20ac3d6577e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.421993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b331a-f2bf-4b45-81fe-b20ac3d6577e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.455240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6a4c1-ea7f-4def-88a4-bf9a817cc83a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.458947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdb425-1c1a-40e6-8074-5df9141c082d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e839d1074f24a5ba7a552472e167067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.459591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdb425-1c1a-40e6-8074-5df9141c082d service glance] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.459876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdb425-1c1a-40e6-8074-5df9141c082d service glance] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.460160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdb425-1c1a-40e6-8074-5df9141c082d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.469321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdb425-1c1a-40e6-8074-5df9141c082d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.470890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdb425-1c1a-40e6-8074-5df9141c082d service glance] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.479929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1040/2049] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:25.496163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1010/2050] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:25 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:25.497417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdb425-1c1a-40e6-8074-5df9141c082d service glance] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.510662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdb425-1c1a-40e6-8074-5df9141c082d service glance] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.576298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb4e9f-db2e-49dc-997f-9e1935b57f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.577473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb4e9f-db2e-49dc-997f-9e1935b57f77 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.577473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb4e9f-db2e-49dc-997f-9e1935b57f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.577745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb4e9f-db2e-49dc-997f-9e1935b57f77 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.578680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb4e9f-db2e-49dc-997f-9e1935b57f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.581222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb4e9f-db2e-49dc-997f-9e1935b57f77 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.704028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1041/2051] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:25 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:25.706739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b331a-f2bf-4b45-81fe-b20ac3d6577e admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.718097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b331a-f2bf-4b45-81fe-b20ac3d6577e admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.723746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263140b-2b73-4f73-9f38-36249230a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.724672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263140b-2b73-4f73-9f38-36249230a7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.724672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263140b-2b73-4f73-9f38-36249230a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.724881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263140b-2b73-4f73-9f38-36249230a7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.725557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263140b-2b73-4f73-9f38-36249230a7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.727196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263140b-2b73-4f73-9f38-36249230a7b6 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.747210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1011/2052] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:25.751299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb4e9f-db2e-49dc-997f-9e1935b57f77 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.761396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb4e9f-db2e-49dc-997f-9e1935b57f77 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.766190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93931e53-25ee-4570-a648-630f52a9bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.767063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93931e53-25ee-4570-a648-630f52a9bf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.767351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93931e53-25ee-4570-a648-630f52a9bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.767626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93931e53-25ee-4570-a648-630f52a9bf48 admin admin] PATH_INFO: `/v3/projects/cbf0856c00fc4e34a8e7fecab50ad186/users/22eaa1223d0a44bc8aebe7c158a7ad5e/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.773011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:25.785867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93931e53-25ee-4570-a648-630f52a9bf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf0856c00fc4e34a8e7fecab50ad186, user_id=22eaa1223d0a44bc8aebe7c158a7ad5e, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.794158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93931e53-25ee-4570-a648-630f52a9bf48 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.816619 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:25.885181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1042/2053] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:25 2022] PUT /identity/v3/projects/cbf0856c00fc4e34a8e7fecab50ad186/users/22eaa1223d0a44bc8aebe7c158a7ad5e/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:25.894473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263140b-2b73-4f73-9f38-36249230a7b6 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.908751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263140b-2b73-4f73-9f38-36249230a7b6 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.977433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bce95-4399-4778-8d0c-111c65659d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.978169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bce95-4399-4778-8d0c-111c65659d1b admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.978467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bce95-4399-4778-8d0c-111c65659d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.978747 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bce95-4399-4778-8d0c-111c65659d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.979503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bce95-4399-4778-8d0c-111c65659d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.981244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bce95-4399-4778-8d0c-111c65659d1b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.996933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1012/2054] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:25.998522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93931e53-25ee-4570-a648-630f52a9bf48 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:26.009566 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93931e53-25ee-4570-a648-630f52a9bf48 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:26.014479 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681b043-cad3-4ec9-9296-6d5fd2e1a873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:26.015396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681b043-cad3-4ec9-9296-6d5fd2e1a873 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.015826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681b043-cad3-4ec9-9296-6d5fd2e1a873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.016108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681b043-cad3-4ec9-9296-6d5fd2e1a873 admin admin] PATH_INFO: `/v3/projects/cbf0856c00fc4e34a8e7fecab50ad186/users/22eaa1223d0a44bc8aebe7c158a7ad5e/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.018491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681b043-cad3-4ec9-9296-6d5fd2e1a873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf0856c00fc4e34a8e7fecab50ad186, user_id=22eaa1223d0a44bc8aebe7c158a7ad5e, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:26.021312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681b043-cad3-4ec9-9296-6d5fd2e1a873 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:26.033364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1043/2055] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:25 2022] PUT /identity/v3/projects/cbf0856c00fc4e34a8e7fecab50ad186/users/22eaa1223d0a44bc8aebe7c158a7ad5e/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:26.044943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e56c26-df2d-49d2-9b42-63b6e34919f9 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.045245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e56c26-df2d-49d2-9b42-63b6e34919f9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.045521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e56c26-df2d-49d2-9b42-63b6e34919f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.078278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-24e56c26-df2d-49d2-9b42-63b6e34919f9 None None] MFA Rules not processed for user `22eaa1223d0a44bc8aebe7c158a7ad5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:26.081070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-24e56c26-df2d-49d2-9b42-63b6e34919f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:26.176130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1013/2056] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:26.260712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681b043-cad3-4ec9-9296-6d5fd2e1a873 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:26.264536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8681b043-cad3-4ec9-9296-6d5fd2e1a873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:26.285577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:26.329794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681b043-cad3-4ec9-9296-6d5fd2e1a873 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:26.333918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ae858-24ff-4e3b-8e34-b356720d127a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:26.334584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae858-24ff-4e3b-8e34-b356720d127a service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.334873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae858-24ff-4e3b-8e34-b356720d127a service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.335152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae858-24ff-4e3b-8e34-b356720d127a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.336918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-474ae858-24ff-4e3b-8e34-b356720d127a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:26.418970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ae858-24ff-4e3b-8e34-b356720d127a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:26.421361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ae858-24ff-4e3b-8e34-b356720d127a service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:26.432453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1044/2057] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:26.570432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:26.685020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:26.885282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:27.125043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:27.604805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:27.804887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:27.970261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:28.273101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:28.324686 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:28.474121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e56c26-df2d-49d2-9b42-63b6e34919f9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:28.474121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-24e56c26-df2d-49d2-9b42-63b6e34919f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:28.485748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e56c26-df2d-49d2-9b42-63b6e34919f9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:28.490180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa71a5-edbf-45b0-9c86-5b3f66e98ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:28.490991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa71a5-edbf-45b0-9c86-5b3f66e98ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:28.491309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa71a5-edbf-45b0-9c86-5b3f66e98ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:28.491849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa71a5-edbf-45b0-9c86-5b3f66e98ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:28.572398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa71a5-edbf-45b0-9c86-5b3f66e98ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:28.573882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa71a5-edbf-45b0-9c86-5b3f66e98ca4 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:28.584391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1014/2058] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:28.879319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:29.056026 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:30.015022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ae858-24ff-4e3b-8e34-b356720d127a service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:30.023727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ae858-24ff-4e3b-8e34-b356720d127a service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:30.027471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaeca2-630b-4abc-bd74-2681762008ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:30.028123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaeca2-630b-4abc-bd74-2681762008ea service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:30.028416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaeca2-630b-4abc-bd74-2681762008ea service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:30.028699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaeca2-630b-4abc-bd74-2681762008ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:30.037792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaeca2-630b-4abc-bd74-2681762008ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:30.044502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaeca2-630b-4abc-bd74-2681762008ea service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:30.048940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1045/2059] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:30.539332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa71a5-edbf-45b0-9c86-5b3f66e98ca4 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:30.540785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-83fa71a5-edbf-45b0-9c86-5b3f66e98ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:30.606992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa71a5-edbf-45b0-9c86-5b3f66e98ca4 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:30.612038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:30.612922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:30.613265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:30.614077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] PATH_INFO: `/v3/users/d552d602c04b4413a1b36681f580f802` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:30.615327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d552d602c04b4413a1b36681f580f802)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:30.617279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:30.772659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd552d602c04b4413a1b36681f580f802'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:30.838780 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd552d602c04b4413a1b36681f580f802'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:30.839406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd552d602c04b4413a1b36681f580f802'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:30.852338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd552d602c04b4413a1b36681f580f802'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:30.853019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd552d602c04b4413a1b36681f580f802'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:30.866351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1015/2060] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:30 2022] DELETE /identity/v3/users/d552d602c04b4413a1b36681f580f802 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:30.870552 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c862a7-f89d-4ce9-bdef-425052e6e8e6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:30.878549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c862a7-f89d-4ce9-bdef-425052e6e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:30.878549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c862a7-f89d-4ce9-bdef-425052e6e8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:30.889678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-94c862a7-f89d-4ce9-bdef-425052e6e8e6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:30.890928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-94c862a7-f89d-4ce9-bdef-425052e6e8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:30.955757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1046/2061] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:30.976579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:30.976579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:31.027359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a9e2-fcde-4a79-9e9a-9ea305010769 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:31.030848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e4650-ef63-43d2-ad8f-9e00fe3b9246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:31.031496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e4650-ef63-43d2-ad8f-9e00fe3b9246 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:31.031784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e4650-ef63-43d2-ad8f-9e00fe3b9246 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:31.032065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e4650-ef63-43d2-ad8f-9e00fe3b9246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:31.041668 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e4650-ef63-43d2-ad8f-9e00fe3b9246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:31.043140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e4650-ef63-43d2-ad8f-9e00fe3b9246 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:31.047085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:31.053734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1016/2062] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:31.475665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c862a7-f89d-4ce9-bdef-425052e6e8e6 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:31.478693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-94c862a7-f89d-4ce9-bdef-425052e6e8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:31.494049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c862a7-f89d-4ce9-bdef-425052e6e8e6 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:31.514272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:31.515303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:31.515595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:31.515877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] PATH_INFO: `/v3/projects/35fa9974b88d4ae1a41b311aeaa56d84` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:31.517601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fa9974b88d4ae1a41b311aeaa56d84)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:31.519582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:31.651859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:31.657304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fa9974b88d4ae1a41b311aeaa56d84', 'request_id': 'req-c7fff63a-70ab-4c79-8f77-b5cbca7487da'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:31.731939 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fa9974b88d4ae1a41b311aeaa56d84', 'request_id': 'req-c7fff63a-70ab-4c79-8f77-b5cbca7487da'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:31.738742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fa9974b88d4ae1a41b311aeaa56d84', 'request_id': 'req-c7fff63a-70ab-4c79-8f77-b5cbca7487da'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:31.752142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] The token cache is being invalidate because project 35fa9974b88d4ae1a41b311aeaa56d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:31.755953 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:31.756676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7fff63a-70ab-4c79-8f77-b5cbca7487da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:31.758539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1047/2063] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:31 2022] DELETE /identity/v3/projects/35fa9974b88d4ae1a41b311aeaa56d84 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:31.764240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae4588-1641-491b-83a2-d52b83264929 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:31.764240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae4588-1641-491b-83a2-d52b83264929 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:31.764240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae4588-1641-491b-83a2-d52b83264929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:31.782642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2dae4588-1641-491b-83a2-d52b83264929 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:31.784142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2dae4588-1641-491b-83a2-d52b83264929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:31.871471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1017/2064] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:31.889420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971f048-569a-41e1-953e-cfdd65d3a159 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:31.889420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971f048-569a-41e1-953e-cfdd65d3a159 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:31.889420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971f048-569a-41e1-953e-cfdd65d3a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:31.907502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7971f048-569a-41e1-953e-cfdd65d3a159 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:31.909253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7971f048-569a-41e1-953e-cfdd65d3a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:31.917444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1048/2065] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:31.921863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae4588-1641-491b-83a2-d52b83264929 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:31.931607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae4588-1641-491b-83a2-d52b83264929 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:31.936409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff922335-511f-43a0-bbca-4a2da873c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:31.939123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff922335-511f-43a0-bbca-4a2da873c28c admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:31.939123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff922335-511f-43a0-bbca-4a2da873c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:31.939123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff922335-511f-43a0-bbca-4a2da873c28c admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:31.939123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff922335-511f-43a0-bbca-4a2da873c28c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:31.939123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff922335-511f-43a0-bbca-4a2da873c28c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:31.941547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff922335-511f-43a0-bbca-4a2da873c28c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:31.956166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1018/2066] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:31.961635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971f048-569a-41e1-953e-cfdd65d3a159 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:31.972350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971f048-569a-41e1-953e-cfdd65d3a159 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:31.977242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ba0d4-c03d-4331-8255-20ad2b7f8e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:31.977921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ba0d4-c03d-4331-8255-20ad2b7f8e6e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:31.978217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ba0d4-c03d-4331-8255-20ad2b7f8e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:31.978498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ba0d4-c03d-4331-8255-20ad2b7f8e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:31.979218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ba0d4-c03d-4331-8255-20ad2b7f8e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:31.981211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ba0d4-c03d-4331-8255-20ad2b7f8e6e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:32.080753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1049/2067] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:31 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:32.084965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff922335-511f-43a0-bbca-4a2da873c28c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:32.096753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff922335-511f-43a0-bbca-4a2da873c28c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:32.157994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5b86a-2ceb-4bc7-b3c5-85984c7ec620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:32.158679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5b86a-2ceb-4bc7-b3c5-85984c7ec620 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:32.158973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5b86a-2ceb-4bc7-b3c5-85984c7ec620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:32.159249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5b86a-2ceb-4bc7-b3c5-85984c7ec620 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:32.159967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5b86a-2ceb-4bc7-b3c5-85984c7ec620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:32.162026 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5b86a-2ceb-4bc7-b3c5-85984c7ec620 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:32.285039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1019/2068] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:32 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:32.289254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ba0d4-c03d-4331-8255-20ad2b7f8e6e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:32.299839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ba0d4-c03d-4331-8255-20ad2b7f8e6e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:32.304983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a62d7-72e7-4f49-ae2d-de83254aa79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:32.305673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a62d7-72e7-4f49-ae2d-de83254aa79a admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:32.305991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a62d7-72e7-4f49-ae2d-de83254aa79a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:32.311490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a62d7-72e7-4f49-ae2d-de83254aa79a admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:32.311490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a62d7-72e7-4f49-ae2d-de83254aa79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:32.311490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a62d7-72e7-4f49-ae2d-de83254aa79a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:32.319920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1050/2069] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:32.323876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5b86a-2ceb-4bc7-b3c5-85984c7ec620 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:32.333877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5b86a-2ceb-4bc7-b3c5-85984c7ec620 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:32.338743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57491a0-4ae8-464b-9c49-57e8869b53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:32.339392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57491a0-4ae8-464b-9c49-57e8869b53aa admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:32.339676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57491a0-4ae8-464b-9c49-57e8869b53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:32.340009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57491a0-4ae8-464b-9c49-57e8869b53aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:32.340718 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57491a0-4ae8-464b-9c49-57e8869b53aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:32.342348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57491a0-4ae8-464b-9c49-57e8869b53aa admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:32.353105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1020/2070] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:32.357441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a62d7-72e7-4f49-ae2d-de83254aa79a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:32.368291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a62d7-72e7-4f49-ae2d-de83254aa79a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:32.372849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9da6c3-852d-4798-b68c-b0f848400148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:32.373730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9da6c3-852d-4798-b68c-b0f848400148 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:32.374066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9da6c3-852d-4798-b68c-b0f848400148 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:32.374337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9da6c3-852d-4798-b68c-b0f848400148 admin admin] PATH_INFO: `/v3/projects/beb39f472e5248a7bba96b45f35a8868/users/879c3a225a994aa4af5dc289cd6d34a0/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:32.389885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9da6c3-852d-4798-b68c-b0f848400148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb39f472e5248a7bba96b45f35a8868, user_id=879c3a225a994aa4af5dc289cd6d34a0, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:32.392688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9da6c3-852d-4798-b68c-b0f848400148 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:32.480140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1051/2071] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:32 2022] PUT /identity/v3/projects/beb39f472e5248a7bba96b45f35a8868/users/879c3a225a994aa4af5dc289cd6d34a0/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:32.492261 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c6de-215c-4b98-8fd5-2ae8904d1fa0 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:32.492550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c6de-215c-4b98-8fd5-2ae8904d1fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:32.492834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c6de-215c-4b98-8fd5-2ae8904d1fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:32.521456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a6b6c6de-215c-4b98-8fd5-2ae8904d1fa0 None None] MFA Rules not processed for user `879c3a225a994aa4af5dc289cd6d34a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:32.522698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a6b6c6de-215c-4b98-8fd5-2ae8904d1fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:32.590323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:32.606794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1021/2072] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:32.611424 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9da6c3-852d-4798-b68c-b0f848400148 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:32.693050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9da6c3-852d-4798-b68c-b0f848400148 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:32.704312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7115-9cce-4589-aa14-b9fe49e3eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:32.704984 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7115-9cce-4589-aa14-b9fe49e3eb86 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:32.705298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7115-9cce-4589-aa14-b9fe49e3eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:32.705545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7115-9cce-4589-aa14-b9fe49e3eb86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:32.706446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7115-9cce-4589-aa14-b9fe49e3eb86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:32.708956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7115-9cce-4589-aa14-b9fe49e3eb86 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:32.828747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1052/2073] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:32 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:32.832988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c6de-215c-4b98-8fd5-2ae8904d1fa0 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:32.843787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c6de-215c-4b98-8fd5-2ae8904d1fa0 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:32.900772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69806eb-1be5-4440-a2a4-4a3c28779abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:32.901458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69806eb-1be5-4440-a2a4-4a3c28779abc admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:32.901745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69806eb-1be5-4440-a2a4-4a3c28779abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:32.902064 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69806eb-1be5-4440-a2a4-4a3c28779abc admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:32.902770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69806eb-1be5-4440-a2a4-4a3c28779abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:32.904761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69806eb-1be5-4440-a2a4-4a3c28779abc admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:33.007503 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1022/2074] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:32 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:33.010220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7115-9cce-4589-aa14-b9fe49e3eb86 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:33.020637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7115-9cce-4589-aa14-b9fe49e3eb86 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:33.025288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1b1d9-0958-47f2-979e-1c3a12852227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:33.026061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1b1d9-0958-47f2-979e-1c3a12852227 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:33.026353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1b1d9-0958-47f2-979e-1c3a12852227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:33.026636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1b1d9-0958-47f2-979e-1c3a12852227 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:33.027362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1b1d9-0958-47f2-979e-1c3a12852227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:33.028981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1b1d9-0958-47f2-979e-1c3a12852227 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:33.040275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1053/2075] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:33.044374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69806eb-1be5-4440-a2a4-4a3c28779abc admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:33.055186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69806eb-1be5-4440-a2a4-4a3c28779abc admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:33.060444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ff7c4-5e99-4a24-b08a-13db20ff0bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:33.061332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff7c4-5e99-4a24-b08a-13db20ff0bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:33.061679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff7c4-5e99-4a24-b08a-13db20ff0bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:33.062227 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff7c4-5e99-4a24-b08a-13db20ff0bdb admin admin] PATH_INFO: `/v3/projects/f8c89c1b68c64ce7a915c205fed32721/users/39c1fe37d19e4e71b6286b4322cc493f/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:33.078670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ff7c4-5e99-4a24-b08a-13db20ff0bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c89c1b68c64ce7a915c205fed32721, user_id=39c1fe37d19e4e71b6286b4322cc493f, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:33.081418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ff7c4-5e99-4a24-b08a-13db20ff0bdb admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:33.154827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1023/2076] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:33 2022] PUT /identity/v3/projects/f8c89c1b68c64ce7a915c205fed32721/users/39c1fe37d19e4e71b6286b4322cc493f/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:33.158845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1b1d9-0958-47f2-979e-1c3a12852227 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:33.169827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1b1d9-0958-47f2-979e-1c3a12852227 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:33.208933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:33.227380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019aec5-6695-42a7-87f4-a9f1cf169e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:33.230704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019aec5-6695-42a7-87f4-a9f1cf169e51 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:33.230704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019aec5-6695-42a7-87f4-a9f1cf169e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:33.230704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019aec5-6695-42a7-87f4-a9f1cf169e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:33.230704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019aec5-6695-42a7-87f4-a9f1cf169e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:33.231328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019aec5-6695-42a7-87f4-a9f1cf169e51 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:33.242210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1054/2077] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:33.246193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ff7c4-5e99-4a24-b08a-13db20ff0bdb admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:33.272277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ff7c4-5e99-4a24-b08a-13db20ff0bdb admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:33.272277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aefb3-84dc-4d59-9d49-839bb2147c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:33.272277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aefb3-84dc-4d59-9d49-839bb2147c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:33.272277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aefb3-84dc-4d59-9d49-839bb2147c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:33.272948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aefb3-84dc-4d59-9d49-839bb2147c02 admin admin] PATH_INFO: `/v3/projects/f8c89c1b68c64ce7a915c205fed32721/users/39c1fe37d19e4e71b6286b4322cc493f/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:33.272948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aefb3-84dc-4d59-9d49-839bb2147c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c89c1b68c64ce7a915c205fed32721, user_id=39c1fe37d19e4e71b6286b4322cc493f, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:33.275224 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aefb3-84dc-4d59-9d49-839bb2147c02 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:33.288145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1024/2078] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:33 2022] PUT /identity/v3/projects/f8c89c1b68c64ce7a915c205fed32721/users/39c1fe37d19e4e71b6286b4322cc493f/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:33.298483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96493b-bc72-4033-85b5-cd4e10242837 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:33.299101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96493b-bc72-4033-85b5-cd4e10242837 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:33.299391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96493b-bc72-4033-85b5-cd4e10242837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:33.343531 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-dd96493b-bc72-4033-85b5-cd4e10242837 None None] MFA Rules not processed for user `39c1fe37d19e4e71b6286b4322cc493f`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:33.344751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-dd96493b-bc72-4033-85b5-cd4e10242837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:33.420673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1055/2079] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:33.431806 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aefb3-84dc-4d59-9d49-839bb2147c02 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:33.433584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8f9aefb3-84dc-4d59-9d49-839bb2147c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:33.497651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aefb3-84dc-4d59-9d49-839bb2147c02 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:33.501025 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da7351-a405-46d2-9f68-973b4499fb7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:33.505259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da7351-a405-46d2-9f68-973b4499fb7c service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:33.505259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da7351-a405-46d2-9f68-973b4499fb7c service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:33.505259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da7351-a405-46d2-9f68-973b4499fb7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:33.511197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da7351-a405-46d2-9f68-973b4499fb7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:33.512666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da7351-a405-46d2-9f68-973b4499fb7c service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:33.523245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1025/2080] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:34.074963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96493b-bc72-4033-85b5-cd4e10242837 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:34.150290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96493b-bc72-4033-85b5-cd4e10242837 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:34.160214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:34.160214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:34.160214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:34.160214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] PATH_INFO: `/v3/users/879c3a225a994aa4af5dc289cd6d34a0` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:34.160570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=879c3a225a994aa4af5dc289cd6d34a0)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:34.160570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:34.377185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879c3a225a994aa4af5dc289cd6d34a0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:34.432401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879c3a225a994aa4af5dc289cd6d34a0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:34.441922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:34.446550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879c3a225a994aa4af5dc289cd6d34a0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:34.447258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879c3a225a994aa4af5dc289cd6d34a0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:34.454260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879c3a225a994aa4af5dc289cd6d34a0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:34.461536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1056/2081] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:34 2022] DELETE /identity/v3/users/879c3a225a994aa4af5dc289cd6d34a0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:34.466763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a6dd-f2fc-48f8-9521-c6eb4bea64bd None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:34.467292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a6dd-f2fc-48f8-9521-c6eb4bea64bd None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:34.467400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a6dd-f2fc-48f8-9521-c6eb4bea64bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:34.488713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f415a6dd-f2fc-48f8-9521-c6eb4bea64bd None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:34.490243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f415a6dd-f2fc-48f8-9521-c6eb4bea64bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:34.537096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:34.552271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1026/2082] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:34.561610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:34.563187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:34.626475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cf3c0-6095-4b92-a3a8-f14a09682dad admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:34.632160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afd216-e4bf-4b37-bf3b-d2fe1c477511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:34.632642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afd216-e4bf-4b37-bf3b-d2fe1c477511 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:34.632934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afd216-e4bf-4b37-bf3b-d2fe1c477511 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:34.633210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afd216-e4bf-4b37-bf3b-d2fe1c477511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:34.643306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afd216-e4bf-4b37-bf3b-d2fe1c477511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:34.646117 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afd216-e4bf-4b37-bf3b-d2fe1c477511 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:34.655398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1057/2083] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:34.656852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a6dd-f2fc-48f8-9521-c6eb4bea64bd None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:34.658257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f415a6dd-f2fc-48f8-9521-c6eb4bea64bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:34.670404 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a6dd-f2fc-48f8-9521-c6eb4bea64bd None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:34.675716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:34.677208 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:34.677499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:34.677824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] PATH_INFO: `/v3/users/20286d268ba74a979a60be27fbad792b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:34.679068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20286d268ba74a979a60be27fbad792b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:34.681310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:34.908775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20286d268ba74a979a60be27fbad792b'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.022487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20286d268ba74a979a60be27fbad792b'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.023286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20286d268ba74a979a60be27fbad792b'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.044025 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20286d268ba74a979a60be27fbad792b'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.048546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20286d268ba74a979a60be27fbad792b'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.074893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1027/2084] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:34 2022] DELETE /identity/v3/users/20286d268ba74a979a60be27fbad792b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:35.077090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f0619-55c0-4b09-9439-29e2f385dfa7 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:35.077681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f0619-55c0-4b09-9439-29e2f385dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:35.077681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f0619-55c0-4b09-9439-29e2f385dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:35.106671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-332f0619-55c0-4b09-9439-29e2f385dfa7 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:35.108000 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-332f0619-55c0-4b09-9439-29e2f385dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:35.113175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:35.115769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:35.178350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1058/2085] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:35.187744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f0619-55c0-4b09-9439-29e2f385dfa7 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:35.189164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-332f0619-55c0-4b09-9439-29e2f385dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:35.199150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647d4e6-be58-4c3a-a930-225dea8b8be1 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:35.200634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:35.201602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:35.201841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:35.202160 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] PATH_INFO: `/v3/projects/beb39f472e5248a7bba96b45f35a8868` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:35.203375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb39f472e5248a7bba96b45f35a8868)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:35.205308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:35.254705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f0619-55c0-4b09-9439-29e2f385dfa7 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:35.258823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30dbb-9382-4210-bbd6-8604893a15e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:35.259496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30dbb-9382-4210-bbd6-8604893a15e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:35.259777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30dbb-9382-4210-bbd6-8604893a15e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:35.260102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30dbb-9382-4210-bbd6-8604893a15e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:35.269420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a30dbb-9382-4210-bbd6-8604893a15e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:35.270944 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a30dbb-9382-4210-bbd6-8604893a15e9 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:35.280556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1059/2086] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:35.320359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb39f472e5248a7bba96b45f35a8868', 'request_id': 'req-ade2d4ea-50e4-4bc3-8785-253267057f76'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.326847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb39f472e5248a7bba96b45f35a8868', 'request_id': 'req-ade2d4ea-50e4-4bc3-8785-253267057f76'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.404825 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb39f472e5248a7bba96b45f35a8868', 'request_id': 'req-ade2d4ea-50e4-4bc3-8785-253267057f76'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.407240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:35.416676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] The token cache is being invalidate because project beb39f472e5248a7bba96b45f35a8868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:35.416965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.417627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.419311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1028/2087] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:35 2022] DELETE /identity/v3/projects/beb39f472e5248a7bba96b45f35a8868 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:35.423273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30dbb-9382-4210-bbd6-8604893a15e9 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:35.434073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30dbb-9382-4210-bbd6-8604893a15e9 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:35.464475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:35.514181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:35.515296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:35.515784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:35.516260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] PATH_INFO: `/v3/users/39c1fe37d19e4e71b6286b4322cc493f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:35.518858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c1fe37d19e4e71b6286b4322cc493f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:35.520847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:35.698031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c1fe37d19e4e71b6286b4322cc493f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.708990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:35.710583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:35.725583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d4ea-50e4-4bc3-8785-253267057f76 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:35.736617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:35.736617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:35.736617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:35.736617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] PATH_INFO: `/v3/projects/a2a40dd9c93c4c34862401e4e6fa4e6e` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:35.737344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a40dd9c93c4c34862401e4e6fa4e6e)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:35.737344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:35.781616 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c1fe37d19e4e71b6286b4322cc493f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.799435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c1fe37d19e4e71b6286b4322cc493f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.800186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c1fe37d19e4e71b6286b4322cc493f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.808401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c1fe37d19e4e71b6286b4322cc493f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.814711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1060/2088] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:35 2022] DELETE /identity/v3/users/39c1fe37d19e4e71b6286b4322cc493f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:35.871690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a40dd9c93c4c34862401e4e6fa4e6e', 'request_id': 'req-a43bb7d8-0040-440b-b04c-30e465870146'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.881976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a40dd9c93c4c34862401e4e6fa4e6e', 'request_id': 'req-a43bb7d8-0040-440b-b04c-30e465870146'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.941192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a40dd9c93c4c34862401e4e6fa4e6e', 'request_id': 'req-a43bb7d8-0040-440b-b04c-30e465870146'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.953649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] The token cache is being invalidate because project a2a40dd9c93c4c34862401e4e6fa4e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:35.953960 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.954668 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:35.956506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1029/2089] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:35 2022] DELETE /identity/v3/projects/a2a40dd9c93c4c34862401e4e6fa4e6e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:35.960353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:35.961860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:36.027933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b9660-e282-4b51-8821-8c091f5bb878 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:36.080635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:36.087688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:36.088825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.089149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.089377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] PATH_INFO: `/v3/users/c85094deb6de44a39bf3589d96398ba2` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.090635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85094deb6de44a39bf3589d96398ba2)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:36.092604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:36.331285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85094deb6de44a39bf3589d96398ba2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.366986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:36.368438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:36.381277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bb7d8-0040-440b-b04c-30e465870146 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:36.385904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:36.386803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.387087 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.387368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] PATH_INFO: `/v3/projects/f8c89c1b68c64ce7a915c205fed32721` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.388576 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c89c1b68c64ce7a915c205fed32721)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:36.390520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:36.452911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85094deb6de44a39bf3589d96398ba2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.467478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85094deb6de44a39bf3589d96398ba2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.468235 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85094deb6de44a39bf3589d96398ba2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.476569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bd82b9ef-28b2-45d6-aa43-5296434130f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85094deb6de44a39bf3589d96398ba2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.482600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1061/2090] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:35 2022] DELETE /identity/v3/users/c85094deb6de44a39bf3589d96398ba2 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:36.550553 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c89c1b68c64ce7a915c205fed32721', 'request_id': 'req-b8742140-e3d0-4747-b67e-e5410e8f89e9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.557232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c89c1b68c64ce7a915c205fed32721', 'request_id': 'req-b8742140-e3d0-4747-b67e-e5410e8f89e9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.638331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c89c1b68c64ce7a915c205fed32721', 'request_id': 'req-b8742140-e3d0-4747-b67e-e5410e8f89e9'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.649893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] The token cache is being invalidate because project f8c89c1b68c64ce7a915c205fed32721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:36.650255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.650954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b8742140-e3d0-4747-b67e-e5410e8f89e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.652499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1030/2091] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:36 2022] DELETE /identity/v3/projects/f8c89c1b68c64ce7a915c205fed32721 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:36.659952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b9250-6b45-442c-b250-2f7022da4b2b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.660249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b9250-6b45-442c-b250-2f7022da4b2b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.660536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b9250-6b45-442c-b250-2f7022da4b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.679599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-302b9250-6b45-442c-b250-2f7022da4b2b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:36.680958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-302b9250-6b45-442c-b250-2f7022da4b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:36.761097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1062/2092] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:36.769841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90a343-66d5-45d6-929c-43aa5a0ba223 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.770407 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90a343-66d5-45d6-929c-43aa5a0ba223 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.770764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90a343-66d5-45d6-929c-43aa5a0ba223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.790987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-eb90a343-66d5-45d6-929c-43aa5a0ba223 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:36.792200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-eb90a343-66d5-45d6-929c-43aa5a0ba223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:36.800483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1031/2093] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:36.805277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b9250-6b45-442c-b250-2f7022da4b2b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:36.815123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b9250-6b45-442c-b250-2f7022da4b2b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:36.820338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:36.821064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.821417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.821761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.822591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:36.822964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:36.824664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:36.836941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1063/2094] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:36.842826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90a343-66d5-45d6-929c-43aa5a0ba223 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:36.852007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90a343-66d5-45d6-929c-43aa5a0ba223 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:36.856674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935264bb-9520-41c9-aa2e-2b9b76054380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:36.857321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935264bb-9520-41c9-aa2e-2b9b76054380 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.857616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935264bb-9520-41c9-aa2e-2b9b76054380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.857894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935264bb-9520-41c9-aa2e-2b9b76054380 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.858615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935264bb-9520-41c9-aa2e-2b9b76054380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:36.860516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935264bb-9520-41c9-aa2e-2b9b76054380 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:36.920166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:36.921932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:36.937248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd234-6860-4ab1-a644-9e71e600fea2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:36.950273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1032/2095] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:36 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:36.954863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935264bb-9520-41c9-aa2e-2b9b76054380 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:36.958058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:36.959128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.959499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.959859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] PATH_INFO: `/v3/projects/c85fcd4094e54ab58a56331dc73648c9` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.961154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85fcd4094e54ab58a56331dc73648c9)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:36.963716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:36.998057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:37.028239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935264bb-9520-41c9-aa2e-2b9b76054380 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.033459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a8e9-dd7b-42fc-a267-93b92e60795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.034183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a8e9-dd7b-42fc-a267-93b92e60795f admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.034474 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a8e9-dd7b-42fc-a267-93b92e60795f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.034793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a8e9-dd7b-42fc-a267-93b92e60795f admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.035483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7a8e9-dd7b-42fc-a267-93b92e60795f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.038036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7a8e9-dd7b-42fc-a267-93b92e60795f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.056341 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85fcd4094e54ab58a56331dc73648c9', 'request_id': 'req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.124173 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1033/2096] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:36 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:37.128284 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a8e9-dd7b-42fc-a267-93b92e60795f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.130620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85fcd4094e54ab58a56331dc73648c9', 'request_id': 'req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.132814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:37.140769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85fcd4094e54ab58a56331dc73648c9', 'request_id': 'req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.143123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a8e9-dd7b-42fc-a267-93b92e60795f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.153574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] The token cache is being invalidate because project c85fcd4094e54ab58a56331dc73648c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:37.153772 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.154490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.156244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1064/2097] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:36 2022] DELETE /identity/v3/projects/c85fcd4094e54ab58a56331dc73648c9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:37.159878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.161830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.206518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fd070-5972-404e-8af5-8a5b1af7bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.207201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fd070-5972-404e-8af5-8a5b1af7bf59 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.207504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fd070-5972-404e-8af5-8a5b1af7bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.208086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fd070-5972-404e-8af5-8a5b1af7bf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.209071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fd070-5972-404e-8af5-8a5b1af7bf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.210767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fd070-5972-404e-8af5-8a5b1af7bf59 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.222930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1034/2098] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:37.227075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fd070-5972-404e-8af5-8a5b1af7bf59 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.228813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1b9fd070-5972-404e-8af5-8a5b1af7bf59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.235682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516b0dc-5dbb-4081-a3cc-ad1e26006f1c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.243106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.243106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.243106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.243106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] PATH_INFO: `/v3/users/22eaa1223d0a44bc8aebe7c158a7ad5e` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.243563 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fd070-5972-404e-8af5-8a5b1af7bf59 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.244379 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22eaa1223d0a44bc8aebe7c158a7ad5e)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.246349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.247432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b443a-5a27-4681-9668-8ff7e5894c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.248077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b443a-5a27-4681-9668-8ff7e5894c34 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.248454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b443a-5a27-4681-9668-8ff7e5894c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.248742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b443a-5a27-4681-9668-8ff7e5894c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.249466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b443a-5a27-4681-9668-8ff7e5894c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.251077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b443a-5a27-4681-9668-8ff7e5894c34 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.264442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1035/2099] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:37.265506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b443a-5a27-4681-9668-8ff7e5894c34 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.276377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b443a-5a27-4681-9668-8ff7e5894c34 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.281234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc0f8e-5c63-48ad-9d26-f9cc46a145c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.282144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc0f8e-5c63-48ad-9d26-f9cc46a145c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.282473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc0f8e-5c63-48ad-9d26-f9cc46a145c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.282751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc0f8e-5c63-48ad-9d26-f9cc46a145c8 admin admin] PATH_INFO: `/v3/projects/b01518eac7d34d58a33e0b27bc02a579/users/74d084f54ca3482696c98ed0dd3c6cf4/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.298610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc0f8e-5c63-48ad-9d26-f9cc46a145c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01518eac7d34d58a33e0b27bc02a579, user_id=74d084f54ca3482696c98ed0dd3c6cf4, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.301396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc0f8e-5c63-48ad-9d26-f9cc46a145c8 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.381266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1036/2100] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:37 2022] PUT /identity/v3/projects/b01518eac7d34d58a33e0b27bc02a579/users/74d084f54ca3482696c98ed0dd3c6cf4/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:37.392082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8013f-1d5e-483a-b9d8-68d3efe0e322 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.392378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8013f-1d5e-483a-b9d8-68d3efe0e322 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.392666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8013f-1d5e-483a-b9d8-68d3efe0e322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.415519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22eaa1223d0a44bc8aebe7c158a7ad5e'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.425116 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-cce8013f-1d5e-483a-b9d8-68d3efe0e322 None None] MFA Rules not processed for user `74d084f54ca3482696c98ed0dd3c6cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:37.426395 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-cce8013f-1d5e-483a-b9d8-68d3efe0e322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.472509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22eaa1223d0a44bc8aebe7c158a7ad5e'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.485652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22eaa1223d0a44bc8aebe7c158a7ad5e'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.486338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22eaa1223d0a44bc8aebe7c158a7ad5e'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.492858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1037/2101] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:37.493716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22eaa1223d0a44bc8aebe7c158a7ad5e'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.497190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8013f-1d5e-483a-b9d8-68d3efe0e322 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.499977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1065/2102] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:37 2022] DELETE /identity/v3/users/22eaa1223d0a44bc8aebe7c158a7ad5e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:37.508791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:37.562484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8013f-1d5e-483a-b9d8-68d3efe0e322 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.627670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7bac7-4d88-4788-9db0-b4b56a375f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.628288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7bac7-4d88-4788-9db0-b4b56a375f07 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.628578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7bac7-4d88-4788-9db0-b4b56a375f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.628859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7bac7-4d88-4788-9db0-b4b56a375f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.630134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7bac7-4d88-4788-9db0-b4b56a375f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.632066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7bac7-4d88-4788-9db0-b4b56a375f07 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.709322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1038/2103] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:37 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:37.713665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.715290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.728396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b14523-b63e-4bb5-802e-f569f2d5286f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.794202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b49be6-9e66-4cb9-a786-86208ab071ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.794912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b49be6-9e66-4cb9-a786-86208ab071ea admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.795182 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b49be6-9e66-4cb9-a786-86208ab071ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.795680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b49be6-9e66-4cb9-a786-86208ab071ea admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.796328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b49be6-9e66-4cb9-a786-86208ab071ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.798496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b49be6-9e66-4cb9-a786-86208ab071ea admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.808303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:37.890925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7bac7-4d88-4788-9db0-b4b56a375f07 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.899047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-32c7bac7-4d88-4788-9db0-b4b56a375f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.899265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1066/2104] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:37 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:37.903456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b49be6-9e66-4cb9-a786-86208ab071ea admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.920778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b49be6-9e66-4cb9-a786-86208ab071ea admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.923436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7bac7-4d88-4788-9db0-b4b56a375f07 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.926617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58d2f4-edc2-4b1d-9770-e95dc5df1c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.927302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58d2f4-edc2-4b1d-9770-e95dc5df1c80 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.927587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58d2f4-edc2-4b1d-9770-e95dc5df1c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.927962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58d2f4-edc2-4b1d-9770-e95dc5df1c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.928759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58d2f4-edc2-4b1d-9770-e95dc5df1c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.930491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58d2f4-edc2-4b1d-9770-e95dc5df1c80 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.931243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.932387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.932776 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.933161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] PATH_INFO: `/v3/projects/cbf0856c00fc4e34a8e7fecab50ad186` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.934625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf0856c00fc4e34a8e7fecab50ad186)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.937312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.946310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1067/2105] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:37.950499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58d2f4-edc2-4b1d-9770-e95dc5df1c80 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.964760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58d2f4-edc2-4b1d-9770-e95dc5df1c80 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.978161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9ea79-3e17-4622-9089-fb863c546fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.982366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9ea79-3e17-4622-9089-fb863c546fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.993474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9ea79-3e17-4622-9089-fb863c546fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.993474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9ea79-3e17-4622-9089-fb863c546fa8 admin admin] PATH_INFO: `/v3/projects/e74633395ac04c27bfa1e5c855833c7d/users/c5b6c2d6edeb430d80b3d9293228f505/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.001694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9ea79-3e17-4622-9089-fb863c546fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74633395ac04c27bfa1e5c855833c7d, user_id=c5b6c2d6edeb430d80b3d9293228f505, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.006328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9ea79-3e17-4622-9089-fb863c546fa8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.062141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1068/2106] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:37 2022] PUT /identity/v3/projects/e74633395ac04c27bfa1e5c855833c7d/users/c5b6c2d6edeb430d80b3d9293228f505/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:38.066571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9ea79-3e17-4622-9089-fb863c546fa8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.080577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf0856c00fc4e34a8e7fecab50ad186', 'request_id': 'req-2b695722-ca25-4e65-803a-f4ffe0550067'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.088590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf0856c00fc4e34a8e7fecab50ad186', 'request_id': 'req-2b695722-ca25-4e65-803a-f4ffe0550067'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.142023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf0856c00fc4e34a8e7fecab50ad186', 'request_id': 'req-2b695722-ca25-4e65-803a-f4ffe0550067'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.144729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9ea79-3e17-4622-9089-fb863c546fa8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.156083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] The token cache is being invalidate because project cbf0856c00fc4e34a8e7fecab50ad186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:38.156381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.157050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2b695722-ca25-4e65-803a-f4ffe0550067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.162909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1039/2107] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:37 2022] DELETE /identity/v3/projects/cbf0856c00fc4e34a8e7fecab50ad186 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:38.164718 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40c34-9ee4-4de1-a5f5-b9e23d39672d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.165244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40c34-9ee4-4de1-a5f5-b9e23d39672d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.165536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40c34-9ee4-4de1-a5f5-b9e23d39672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.187010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2ac40c34-9ee4-4de1-a5f5-b9e23d39672d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:38.188582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2ac40c34-9ee4-4de1-a5f5-b9e23d39672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.214447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:38.223471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccad1d-5ba5-4334-b0b7-90f7372059b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.224746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccad1d-5ba5-4334-b0b7-90f7372059b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.225232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccad1d-5ba5-4334-b0b7-90f7372059b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.225523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccad1d-5ba5-4334-b0b7-90f7372059b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.226347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccad1d-5ba5-4334-b0b7-90f7372059b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.228298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccad1d-5ba5-4334-b0b7-90f7372059b9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.243281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1069/2108] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:38.247346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccad1d-5ba5-4334-b0b7-90f7372059b9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.249279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c7ccad1d-5ba5-4334-b0b7-90f7372059b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.265884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1040/2109] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:38.268269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccad1d-5ba5-4334-b0b7-90f7372059b9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.274366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1ad81-37ff-4f9c-a4aa-4838d37829ea None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.274669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1ad81-37ff-4f9c-a4aa-4838d37829ea None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.279578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1ad81-37ff-4f9c-a4aa-4838d37829ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.279793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bf38a-f575-42a9-97a3-279d41d2752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.279793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bf38a-f575-42a9-97a3-279d41d2752b admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.279793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bf38a-f575-42a9-97a3-279d41d2752b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.279793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bf38a-f575-42a9-97a3-279d41d2752b admin admin] PATH_INFO: `/v3/projects/e74633395ac04c27bfa1e5c855833c7d/users/c5b6c2d6edeb430d80b3d9293228f505/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.280159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bf38a-f575-42a9-97a3-279d41d2752b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74633395ac04c27bfa1e5c855833c7d, user_id=c5b6c2d6edeb430d80b3d9293228f505, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.283451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bf38a-f575-42a9-97a3-279d41d2752b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.298960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1070/2110] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:38 2022] PUT /identity/v3/projects/e74633395ac04c27bfa1e5c855833c7d/users/c5b6c2d6edeb430d80b3d9293228f505/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:38.307046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-35c1ad81-37ff-4f9c-a4aa-4838d37829ea None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:38.308463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-35c1ad81-37ff-4f9c-a4aa-4838d37829ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.310399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857745-3288-4d40-ac37-e993cd3b74a2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.310399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857745-3288-4d40-ac37-e993cd3b74a2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.310595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857745-3288-4d40-ac37-e993cd3b74a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.347097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-e2857745-3288-4d40-ac37-e993cd3b74a2 None None] MFA Rules not processed for user `c5b6c2d6edeb430d80b3d9293228f505`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:38.349967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e2857745-3288-4d40-ac37-e993cd3b74a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.381156 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1041/2111] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:38.385723 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1ad81-37ff-4f9c-a4aa-4838d37829ea None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.395598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1ad81-37ff-4f9c-a4aa-4838d37829ea None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.399688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:38.401036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f7e2c-c04d-4935-a170-60f478ca0e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.401809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f7e2c-c04d-4935-a170-60f478ca0e20 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.402178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f7e2c-c04d-4935-a170-60f478ca0e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.402458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f7e2c-c04d-4935-a170-60f478ca0e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.403475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f7e2c-c04d-4935-a170-60f478ca0e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:38.403594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f7e2c-c04d-4935-a170-60f478ca0e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.405105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f7e2c-c04d-4935-a170-60f478ca0e20 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.423046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1042/2112] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:38.427872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f7e2c-c04d-4935-a170-60f478ca0e20 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.438989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f7e2c-c04d-4935-a170-60f478ca0e20 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.442090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1071/2113] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:38.453745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2857745-3288-4d40-ac37-e993cd3b74a2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.455244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e2857745-3288-4d40-ac37-e993cd3b74a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.455798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a611f-6acc-4ebc-8898-2383e89a0951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.456615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a611f-6acc-4ebc-8898-2383e89a0951 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.456982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a611f-6acc-4ebc-8898-2383e89a0951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.457335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a611f-6acc-4ebc-8898-2383e89a0951 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.458429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a611f-6acc-4ebc-8898-2383e89a0951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.461605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a611f-6acc-4ebc-8898-2383e89a0951 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.534497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2857745-3288-4d40-ac37-e993cd3b74a2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.539208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3324d-0dda-4b5b-90e7-130f043aab53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.539888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3324d-0dda-4b5b-90e7-130f043aab53 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.540180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3324d-0dda-4b5b-90e7-130f043aab53 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.540836 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3324d-0dda-4b5b-90e7-130f043aab53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.553523 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3324d-0dda-4b5b-90e7-130f043aab53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.555119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3324d-0dda-4b5b-90e7-130f043aab53 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.572108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1072/2114] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:38.589972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3324d-0dda-4b5b-90e7-130f043aab53 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.590273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1043/2115] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:38 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:38.606404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3324d-0dda-4b5b-90e7-130f043aab53 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.678159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21867ad7-3605-4083-a2d4-30e2f36d5303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.678838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21867ad7-3605-4083-a2d4-30e2f36d5303 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.679152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21867ad7-3605-4083-a2d4-30e2f36d5303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.679427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21867ad7-3605-4083-a2d4-30e2f36d5303 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.680123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21867ad7-3605-4083-a2d4-30e2f36d5303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.682100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21867ad7-3605-4083-a2d4-30e2f36d5303 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.726698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a611f-6acc-4ebc-8898-2383e89a0951 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.743646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1073/2116] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:38 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:38.747831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21867ad7-3605-4083-a2d4-30e2f36d5303 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.767051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21867ad7-3605-4083-a2d4-30e2f36d5303 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.774344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d172b7-1756-4533-99eb-3e3f7593beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.775185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d172b7-1756-4533-99eb-3e3f7593beeb admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.775594 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d172b7-1756-4533-99eb-3e3f7593beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.775916 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d172b7-1756-4533-99eb-3e3f7593beeb admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.776683 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d172b7-1756-4533-99eb-3e3f7593beeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.778676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d172b7-1756-4533-99eb-3e3f7593beeb admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.792855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1074/2117] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:38.794964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a611f-6acc-4ebc-8898-2383e89a0951 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.796484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d172b7-1756-4533-99eb-3e3f7593beeb admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.798899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b81d9-8fe3-42aa-a65e-a795b3c55871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.799544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b81d9-8fe3-42aa-a65e-a795b3c55871 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.799827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b81d9-8fe3-42aa-a65e-a795b3c55871 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.800101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b81d9-8fe3-42aa-a65e-a795b3c55871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.802090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1d2b81d9-8fe3-42aa-a65e-a795b3c55871 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.806880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d172b7-1756-4533-99eb-3e3f7593beeb admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.812332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9a92-9a65-47ea-abd3-a23a6aa4c64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.812995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9a92-9a65-47ea-abd3-a23a6aa4c64f admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.813284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9a92-9a65-47ea-abd3-a23a6aa4c64f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.813565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9a92-9a65-47ea-abd3-a23a6aa4c64f admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.814333 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a9a92-9a65-47ea-abd3-a23a6aa4c64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.815954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a9a92-9a65-47ea-abd3-a23a6aa4c64f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.826570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1075/2118] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:38.830550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9a92-9a65-47ea-abd3-a23a6aa4c64f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.840967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9a92-9a65-47ea-abd3-a23a6aa4c64f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.845645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71611b-218e-4641-954d-dc20639bc753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.846537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71611b-218e-4641-954d-dc20639bc753 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.846819 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71611b-218e-4641-954d-dc20639bc753 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.847092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71611b-218e-4641-954d-dc20639bc753 admin admin] PATH_INFO: `/v3/projects/bad226990fb84657895fd23285babf43/users/ff627a3b938442c3ad700d7cfb76d321/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.847978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:38.862005 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b81d9-8fe3-42aa-a65e-a795b3c55871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.863054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71611b-218e-4641-954d-dc20639bc753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad226990fb84657895fd23285babf43, user_id=ff627a3b938442c3ad700d7cfb76d321, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.863431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b81d9-8fe3-42aa-a65e-a795b3c55871 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.865765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71611b-218e-4641-954d-dc20639bc753 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.872638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1044/2119] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:38.941141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1076/2120] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:38 2022] PUT /identity/v3/projects/bad226990fb84657895fd23285babf43/users/ff627a3b938442c3ad700d7cfb76d321/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:38.946315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f134b-ee0e-4a48-8c07-041d9ccc5d50 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.946779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f134b-ee0e-4a48-8c07-041d9ccc5d50 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.946909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f134b-ee0e-4a48-8c07-041d9ccc5d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.965269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-327f134b-ee0e-4a48-8c07-041d9ccc5d50 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:38.966530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-327f134b-ee0e-4a48-8c07-041d9ccc5d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:39.034174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1045/2121] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:39.041654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71611b-218e-4641-954d-dc20639bc753 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.043058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8f71611b-218e-4641-954d-dc20639bc753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:39.067037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:39.118580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71611b-218e-4641-954d-dc20639bc753 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.118580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b94d6-8a72-4aff-b4c1-19796a397d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.118783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b94d6-8a72-4aff-b4c1-19796a397d1b service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.118933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b94d6-8a72-4aff-b4c1-19796a397d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.119211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b94d6-8a72-4aff-b4c1-19796a397d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.128491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b94d6-8a72-4aff-b4c1-19796a397d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.130495 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b94d6-8a72-4aff-b4c1-19796a397d1b service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.144294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1077/2122] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:39.431479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f134b-ee0e-4a48-8c07-041d9ccc5d50 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.450646 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f134b-ee0e-4a48-8c07-041d9ccc5d50 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.456922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.458424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.458782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.459065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] PATH_INFO: `/v3/users/74d084f54ca3482696c98ed0dd3c6cf4` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.460419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d084f54ca3482696c98ed0dd3c6cf4)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.462637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.654614 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d084f54ca3482696c98ed0dd3c6cf4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.751989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d084f54ca3482696c98ed0dd3c6cf4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.752668 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d084f54ca3482696c98ed0dd3c6cf4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.766771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d084f54ca3482696c98ed0dd3c6cf4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.767464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d084f54ca3482696c98ed0dd3c6cf4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.780448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1046/2123] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:39 2022] DELETE /identity/v3/users/74d084f54ca3482696c98ed0dd3c6cf4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:39.784874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc6222-cfd2-480a-87da-652f943d5d82 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.785435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc6222-cfd2-480a-87da-652f943d5d82 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.785794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc6222-cfd2-480a-87da-652f943d5d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.806120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3dcc6222-cfd2-480a-87da-652f943d5d82 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:39.807572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3dcc6222-cfd2-480a-87da-652f943d5d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:39.893972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1078/2124] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:39.902988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.904682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:39.976570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa8a37-2af3-4e72-b8c6-e313c6a1dd45 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.980329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8ead2-809b-4535-bcec-d1593ee96c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.981553 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8ead2-809b-4535-bcec-d1593ee96c6f service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.981850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8ead2-809b-4535-bcec-d1593ee96c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.982192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8ead2-809b-4535-bcec-d1593ee96c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.992032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8ead2-809b-4535-bcec-d1593ee96c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.993459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8ead2-809b-4535-bcec-d1593ee96c6f service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.998585 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:40.005482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1047/2125] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:40.525548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc6222-cfd2-480a-87da-652f943d5d82 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.527024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3dcc6222-cfd2-480a-87da-652f943d5d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:40.540475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc6222-cfd2-480a-87da-652f943d5d82 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.545198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.546238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.548343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.548343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] PATH_INFO: `/v3/projects/b01518eac7d34d58a33e0b27bc02a579` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.548343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01518eac7d34d58a33e0b27bc02a579)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.550064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.710928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01518eac7d34d58a33e0b27bc02a579', 'request_id': 'req-98795f6f-3095-4634-9666-2bef2ec04ffa'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:40.815643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01518eac7d34d58a33e0b27bc02a579', 'request_id': 'req-98795f6f-3095-4634-9666-2bef2ec04ffa'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:40.823982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01518eac7d34d58a33e0b27bc02a579', 'request_id': 'req-98795f6f-3095-4634-9666-2bef2ec04ffa'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:40.856393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] The token cache is being invalidate because project b01518eac7d34d58a33e0b27bc02a579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:40.856700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:40.857490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:40.861971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1079/2126] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:40 2022] DELETE /identity/v3/projects/b01518eac7d34d58a33e0b27bc02a579 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:40.863714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8ead2-809b-4535-bcec-d1593ee96c6f service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.873589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8ead2-809b-4535-bcec-d1593ee96c6f service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.957435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.958948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.959239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.959521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] PATH_INFO: `/v3/users/c5b6c2d6edeb430d80b3d9293228f505` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.960788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b6c2d6edeb430d80b3d9293228f505)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.963685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:41.172235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b6c2d6edeb430d80b3d9293228f505'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.243892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b6c2d6edeb430d80b3d9293228f505'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.247247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b6c2d6edeb430d80b3d9293228f505'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.262993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b6c2d6edeb430d80b3d9293228f505'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.263883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-6a6a2dcd-12e2-4f99-afee-f5028c361c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b6c2d6edeb430d80b3d9293228f505'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.278898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1048/2127] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:40 2022] DELETE /identity/v3/users/c5b6c2d6edeb430d80b3d9293228f505 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:41.743690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:41.745178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:41.762152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98795f6f-3095-4634-9666-2bef2ec04ffa admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:41.825863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:41.846900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:41.854802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:41.855211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:41.855500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] PATH_INFO: `/v3/projects/e74633395ac04c27bfa1e5c855833c7d` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:41.858320 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74633395ac04c27bfa1e5c855833c7d)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:41.858984 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.016488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19cb33-ab1d-4f3b-89a5-5f48fedbf036 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.016488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19cb33-ab1d-4f3b-89a5-5f48fedbf036 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.016488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19cb33-ab1d-4f3b-89a5-5f48fedbf036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.016488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3c19cb33-ab1d-4f3b-89a5-5f48fedbf036 None None] MFA Rules not processed for user `b7352f61af2241b0babedb2000f7de17`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:42.016488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3c19cb33-ab1d-4f3b-89a5-5f48fedbf036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:42.016488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1049/2128] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:42.077372 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74633395ac04c27bfa1e5c855833c7d', 'request_id': 'req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.147633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74633395ac04c27bfa1e5c855833c7d', 'request_id': 'req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.155115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74633395ac04c27bfa1e5c855833c7d', 'request_id': 'req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.165741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] The token cache is being invalidate because project e74633395ac04c27bfa1e5c855833c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:42.166058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.166711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec9db72a-9c3e-49c0-836e-ee88a13ba16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.168391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1080/2129] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:41 2022] DELETE /identity/v3/projects/e74633395ac04c27bfa1e5c855833c7d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:42.174367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aaaf3-73e4-441a-9b08-f6a4697e8258 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.180644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aaaf3-73e4-441a-9b08-f6a4697e8258 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.180644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aaaf3-73e4-441a-9b08-f6a4697e8258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.194855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-d19aaaf3-73e4-441a-9b08-f6a4697e8258 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:42.196043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d19aaaf3-73e4-441a-9b08-f6a4697e8258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:42.228409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:42.299066 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086936be-197c-467e-afd5-4a93472325d1 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.299365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086936be-197c-467e-afd5-4a93472325d1 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.299655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086936be-197c-467e-afd5-4a93472325d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.302256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1050/2130] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:42.327524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-086936be-197c-467e-afd5-4a93472325d1 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:42.328886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-086936be-197c-467e-afd5-4a93472325d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:42.344061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aaaf3-73e4-441a-9b08-f6a4697e8258 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.348696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1081/2131] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:42.356781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aaaf3-73e4-441a-9b08-f6a4697e8258 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.366539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0449bc-8876-4a46-95f0-b81d7158c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.367237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0449bc-8876-4a46-95f0-b81d7158c66b admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.367529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0449bc-8876-4a46-95f0-b81d7158c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.368068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0449bc-8876-4a46-95f0-b81d7158c66b admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.368572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0449bc-8876-4a46-95f0-b81d7158c66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:42.368894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0449bc-8876-4a46-95f0-b81d7158c66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.371535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0449bc-8876-4a46-95f0-b81d7158c66b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.384361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1051/2132] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:42.388923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086936be-197c-467e-afd5-4a93472325d1 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.400184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086936be-197c-467e-afd5-4a93472325d1 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.407662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5118d7-63ae-4396-9c8b-4ca06866896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.414654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5118d7-63ae-4396-9c8b-4ca06866896d admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.414654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5118d7-63ae-4396-9c8b-4ca06866896d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.414654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5118d7-63ae-4396-9c8b-4ca06866896d admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.414654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5118d7-63ae-4396-9c8b-4ca06866896d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.414654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5118d7-63ae-4396-9c8b-4ca06866896d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.514871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1082/2133] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:42.518983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0449bc-8876-4a46-95f0-b81d7158c66b admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.532227 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0449bc-8876-4a46-95f0-b81d7158c66b admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.621283 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3928a-a533-4613-988f-d98733ee96ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.622010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3928a-a533-4613-988f-d98733ee96ac admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.622302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3928a-a533-4613-988f-d98733ee96ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.623099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3928a-a533-4613-988f-d98733ee96ac admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.624124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3928a-a533-4613-988f-d98733ee96ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.626497 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3928a-a533-4613-988f-d98733ee96ac admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.706567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1052/2134] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:42.710837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5118d7-63ae-4396-9c8b-4ca06866896d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.725817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5118d7-63ae-4396-9c8b-4ca06866896d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.743147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73b6ef-2a8b-4888-b031-304a616b3f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.744403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73b6ef-2a8b-4888-b031-304a616b3f2c admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.744403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73b6ef-2a8b-4888-b031-304a616b3f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.744403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73b6ef-2a8b-4888-b031-304a616b3f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.745161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73b6ef-2a8b-4888-b031-304a616b3f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.746882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73b6ef-2a8b-4888-b031-304a616b3f2c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.778887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3928a-a533-4613-988f-d98733ee96ac admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.779299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1083/2135] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:42.792235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3928a-a533-4613-988f-d98733ee96ac admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.798610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a459d-85d4-4bf8-9900-5d3d945112fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.799255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a459d-85d4-4bf8-9900-5d3d945112fe admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.799661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a459d-85d4-4bf8-9900-5d3d945112fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.800043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a459d-85d4-4bf8-9900-5d3d945112fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.800944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a459d-85d4-4bf8-9900-5d3d945112fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.803852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a459d-85d4-4bf8-9900-5d3d945112fe admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.821498 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1053/2136] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:42.822871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73b6ef-2a8b-4888-b031-304a616b3f2c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.834267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73b6ef-2a8b-4888-b031-304a616b3f2c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.841096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8af220-085f-4074-832d-b497a1699045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.842270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8af220-085f-4074-832d-b497a1699045 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.842638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8af220-085f-4074-832d-b497a1699045 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.843061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8af220-085f-4074-832d-b497a1699045 admin admin] PATH_INFO: `/v3/projects/bc73ec35b8114013970d16321c7020d5/users/8cddc23682ed4e8cb9e68a92d2b67d49/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.865170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8af220-085f-4074-832d-b497a1699045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc73ec35b8114013970d16321c7020d5, user_id=8cddc23682ed4e8cb9e68a92d2b67d49, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.868107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8af220-085f-4074-832d-b497a1699045 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.971976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1084/2137] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:42 2022] PUT /identity/v3/projects/bc73ec35b8114013970d16321c7020d5/users/8cddc23682ed4e8cb9e68a92d2b67d49/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:42.982216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1066cdc-6ffc-48b3-bfa5-15976cb854fa None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.982707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1066cdc-6ffc-48b3-bfa5-15976cb854fa None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.983094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1066cdc-6ffc-48b3-bfa5-15976cb854fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:43.016458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e1066cdc-6ffc-48b3-bfa5-15976cb854fa None None] MFA Rules not processed for user `8cddc23682ed4e8cb9e68a92d2b67d49`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:43.018015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e1066cdc-6ffc-48b3-bfa5-15976cb854fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:43.153699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1054/2138] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:43.168391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8af220-085f-4074-832d-b497a1699045 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:43.172999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2e8af220-085f-4074-832d-b497a1699045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:43.263802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8af220-085f-4074-832d-b497a1699045 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:43.269125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a5359-0d04-451b-a53c-61c23a9bf1b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e839d1074f24a5ba7a552472e167067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:43.270020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a5359-0d04-451b-a53c-61c23a9bf1b6 service glance] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:43.270414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a5359-0d04-451b-a53c-61c23a9bf1b6 service glance] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:43.270914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a5359-0d04-451b-a53c-61c23a9bf1b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:43.281980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a5359-0d04-451b-a53c-61c23a9bf1b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:43.283921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a5359-0d04-451b-a53c-61c23a9bf1b6 service glance] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:43.314265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1085/2139] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:45.994716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85c44f-a7ed-449a-8710-c14baeb523f9 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:45.994716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85c44f-a7ed-449a-8710-c14baeb523f9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:45.994716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85c44f-a7ed-449a-8710-c14baeb523f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:46.046540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ec85c44f-a7ed-449a-8710-c14baeb523f9 None None] MFA Rules not processed for user `ff627a3b938442c3ad700d7cfb76d321`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:46.047801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ec85c44f-a7ed-449a-8710-c14baeb523f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:46.064262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:46.140572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1055/2140] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:46.145442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a5359-0d04-451b-a53c-61c23a9bf1b6 service glance] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:46.146916 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f68a5359-0d04-451b-a53c-61c23a9bf1b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:46.198403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:46.283167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a5359-0d04-451b-a53c-61c23a9bf1b6 service glance] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:46.289716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5b69d-b016-431b-bed3-ac8745924d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:46.290519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5b69d-b016-431b-bed3-ac8745924d10 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:46.290880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5b69d-b016-431b-bed3-ac8745924d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:46.291227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5b69d-b016-431b-bed3-ac8745924d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:46.292003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5b69d-b016-431b-bed3-ac8745924d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:46.294545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5b69d-b016-431b-bed3-ac8745924d10 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:46.405771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1086/2141] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:46 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:46.410027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85c44f-a7ed-449a-8710-c14baeb523f9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:46.423782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85c44f-a7ed-449a-8710-c14baeb523f9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:46.515488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775ed62-16ce-40c5-8fd9-84afb565665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:46.516452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775ed62-16ce-40c5-8fd9-84afb565665b admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:46.517205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775ed62-16ce-40c5-8fd9-84afb565665b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:46.517618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775ed62-16ce-40c5-8fd9-84afb565665b admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:46.524636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775ed62-16ce-40c5-8fd9-84afb565665b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:46.524636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775ed62-16ce-40c5-8fd9-84afb565665b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:46.643252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1056/2142] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:46 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:46.647927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5b69d-b016-431b-bed3-ac8745924d10 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:46.670648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5b69d-b016-431b-bed3-ac8745924d10 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:46.694753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bd88a-4abc-4c57-abfa-ccb1f7794b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:46.695557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bd88a-4abc-4c57-abfa-ccb1f7794b25 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:46.695771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bd88a-4abc-4c57-abfa-ccb1f7794b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:46.696052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bd88a-4abc-4c57-abfa-ccb1f7794b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:46.697007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bd88a-4abc-4c57-abfa-ccb1f7794b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:46.699110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bd88a-4abc-4c57-abfa-ccb1f7794b25 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:46.712119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1087/2143] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:46.715951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775ed62-16ce-40c5-8fd9-84afb565665b admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:46.731849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775ed62-16ce-40c5-8fd9-84afb565665b admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:46.743040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b5b5-00fc-482c-90af-baa0646c0e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:46.744042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b5b5-00fc-482c-90af-baa0646c0e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:46.744387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b5b5-00fc-482c-90af-baa0646c0e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:46.744662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b5b5-00fc-482c-90af-baa0646c0e38 admin admin] PATH_INFO: `/v3/projects/2be2fc55b7234b1fbd188718fd97fa02/users/72b059821b0940f3a7129941923c6314/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:46.767249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4b5b5-00fc-482c-90af-baa0646c0e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be2fc55b7234b1fbd188718fd97fa02, user_id=72b059821b0940f3a7129941923c6314, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:46.770217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4b5b5-00fc-482c-90af-baa0646c0e38 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:46.822194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1057/2144] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:46 2022] PUT /identity/v3/projects/2be2fc55b7234b1fbd188718fd97fa02/users/72b059821b0940f3a7129941923c6314/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:46.829627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bd88a-4abc-4c57-abfa-ccb1f7794b25 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:46.841739 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bd88a-4abc-4c57-abfa-ccb1f7794b25 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:46.920316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af6407-6442-41b6-919d-4593922945a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:46.921166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6407-6442-41b6-919d-4593922945a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:46.921532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6407-6442-41b6-919d-4593922945a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:46.921888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6407-6442-41b6-919d-4593922945a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:46.922788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af6407-6442-41b6-919d-4593922945a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:46.924661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af6407-6442-41b6-919d-4593922945a9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:46.944966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1088/2145] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:46.949243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b5b5-00fc-482c-90af-baa0646c0e38 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:46.960405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b5b5-00fc-482c-90af-baa0646c0e38 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:46.965661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745eecd6-5a19-4a4c-8290-0c7b26368f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:46.966713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745eecd6-5a19-4a4c-8290-0c7b26368f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:46.967582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745eecd6-5a19-4a4c-8290-0c7b26368f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:46.967582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745eecd6-5a19-4a4c-8290-0c7b26368f96 admin admin] PATH_INFO: `/v3/projects/2be2fc55b7234b1fbd188718fd97fa02/users/72b059821b0940f3a7129941923c6314/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:46.969604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745eecd6-5a19-4a4c-8290-0c7b26368f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be2fc55b7234b1fbd188718fd97fa02, user_id=72b059821b0940f3a7129941923c6314, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:46.972988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745eecd6-5a19-4a4c-8290-0c7b26368f96 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:46.987007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1058/2146] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:46 2022] PUT /identity/v3/projects/2be2fc55b7234b1fbd188718fd97fa02/users/72b059821b0940f3a7129941923c6314/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:53.793674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39474c-4657-47e2-9da0-5e498fcd02d0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:53.794202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39474c-4657-47e2-9da0-5e498fcd02d0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:53.794301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39474c-4657-47e2-9da0-5e498fcd02d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:53.834644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-fa39474c-4657-47e2-9da0-5e498fcd02d0 None None] MFA Rules not processed for user `72b059821b0940f3a7129941923c6314`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:53.834644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fa39474c-4657-47e2-9da0-5e498fcd02d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:53.949908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1089/2147] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:53.966859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745eecd6-5a19-4a4c-8290-0c7b26368f96 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:53.973041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-745eecd6-5a19-4a4c-8290-0c7b26368f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:54.053595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:54.084123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745eecd6-5a19-4a4c-8290-0c7b26368f96 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:54.099900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622348b-a6f6-40a9-9fea-27403d686309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:54.102801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622348b-a6f6-40a9-9fea-27403d686309 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:54.102801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622348b-a6f6-40a9-9fea-27403d686309 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:54.102801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622348b-a6f6-40a9-9fea-27403d686309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:54.218290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622348b-a6f6-40a9-9fea-27403d686309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:54.220733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622348b-a6f6-40a9-9fea-27403d686309 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:54.232460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1059/2148] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:56.936831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9939-d4d9-4bfa-a943-af23fc229735 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:56.937368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9939-d4d9-4bfa-a943-af23fc229735 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:56.937368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9939-d4d9-4bfa-a943-af23fc229735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:56.954771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-2d5b9939-d4d9-4bfa-a943-af23fc229735 None None] MFA Rules not processed for user `ff627a3b938442c3ad700d7cfb76d321`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:56.956096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2d5b9939-d4d9-4bfa-a943-af23fc229735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:56.963624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1090/2149] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:57.518212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622348b-a6f6-40a9-9fea-27403d686309 service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:57.519867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8622348b-a6f6-40a9-9fea-27403d686309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:57.604350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622348b-a6f6-40a9-9fea-27403d686309 service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:57.609259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:57.610118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:57.610443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:57.610739 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] PATH_INFO: `/v3/users/47378065db004dd79e895aa7e8eba411` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:57.612103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47378065db004dd79e895aa7e8eba411)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:57.614122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:57.825312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47378065db004dd79e895aa7e8eba411'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:57.934555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47378065db004dd79e895aa7e8eba411'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:57.935354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47378065db004dd79e895aa7e8eba411'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:57.950539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47378065db004dd79e895aa7e8eba411'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:57.951930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47378065db004dd79e895aa7e8eba411'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:57.970017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1060/2150] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:57 2022] DELETE /identity/v3/users/47378065db004dd79e895aa7e8eba411 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:57.975842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35507c-b948-4b61-9480-774c767b3cff None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:57.975842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35507c-b948-4b61-9480-774c767b3cff None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:57.975842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35507c-b948-4b61-9480-774c767b3cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:57.982165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:57.994408 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-2b35507c-b948-4b61-9480-774c767b3cff None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:57.995779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2b35507c-b948-4b61-9480-774c767b3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:58.059267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1091/2151] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:58.069389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:58.070929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:58.092376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:58.143034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e507d4-1563-4769-a310-22a9b2c2ec8a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:58.148874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1121b48-829d-4398-b904-a30cd1606aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:58.149791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1121b48-829d-4398-b904-a30cd1606aef service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:58.149791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1121b48-829d-4398-b904-a30cd1606aef service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:58.149791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1121b48-829d-4398-b904-a30cd1606aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:58.161931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1121b48-829d-4398-b904-a30cd1606aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:58.164494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1121b48-829d-4398-b904-a30cd1606aef service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:58.182405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1061/2152] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:58.907917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35507c-b948-4b61-9480-774c767b3cff None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:58.909818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2b35507c-b948-4b61-9480-774c767b3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:58.928981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35507c-b948-4b61-9480-774c767b3cff None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:58.935861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:58.937111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:58.937657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:58.938115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] PATH_INFO: `/v3/projects/6fd77c4c59704957ae5acc5df8f1a262` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:58.940234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd77c4c59704957ae5acc5df8f1a262)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:58.943426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:59.089400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd77c4c59704957ae5acc5df8f1a262', 'request_id': 'req-7a999a52-3907-4f42-b60f-562ba762c5b7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:59.180391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd77c4c59704957ae5acc5df8f1a262', 'request_id': 'req-7a999a52-3907-4f42-b60f-562ba762c5b7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:59.188017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd77c4c59704957ae5acc5df8f1a262', 'request_id': 'req-7a999a52-3907-4f42-b60f-562ba762c5b7'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:59.207195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] The token cache is being invalidate because project 6fd77c4c59704957ae5acc5df8f1a262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:59.207487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:59.208848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7a999a52-3907-4f42-b60f-562ba762c5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:59.210500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1092/2153] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:58 2022] DELETE /identity/v3/projects/6fd77c4c59704957ae5acc5df8f1a262 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:59.215864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1cd84-7cc6-463b-bfb4-2ec1b4f81ac3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:59.216382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1cd84-7cc6-463b-bfb4-2ec1b4f81ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:59.216512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1cd84-7cc6-463b-bfb4-2ec1b4f81ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:59.235030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6aa1cd84-7cc6-463b-bfb4-2ec1b4f81ac3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:59.236398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6aa1cd84-7cc6-463b-bfb4-2ec1b4f81ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:59.309221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1062/2154] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:59.318826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f8786-501b-4a89-94f7-f313ffdcef35 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:59.319161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f8786-501b-4a89-94f7-f313ffdcef35 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:59.319449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f8786-501b-4a89-94f7-f313ffdcef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:59.345466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1c5f8786-501b-4a89-94f7-f313ffdcef35 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:59.346746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1c5f8786-501b-4a89-94f7-f313ffdcef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:59.357979 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1093/2155] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:59.361992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1cd84-7cc6-463b-bfb4-2ec1b4f81ac3 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:59.389341 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1cd84-7cc6-463b-bfb4-2ec1b4f81ac3 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:59.397237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748778f-2615-41fb-ade7-a7aa1636ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:59.398711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748778f-2615-41fb-ade7-a7aa1636ff20 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:59.399019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748778f-2615-41fb-ade7-a7aa1636ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:59.399290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748778f-2615-41fb-ade7-a7aa1636ff20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:59.400073 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748778f-2615-41fb-ade7-a7aa1636ff20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:59.400443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748778f-2615-41fb-ade7-a7aa1636ff20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:59.403273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748778f-2615-41fb-ade7-a7aa1636ff20 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:59.426633 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1063/2156] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:59.431593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f8786-501b-4a89-94f7-f313ffdcef35 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:59.454848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f8786-501b-4a89-94f7-f313ffdcef35 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:59.462410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b1cfa-6316-4e55-904e-f42ec5a2771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:59.463561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b1cfa-6316-4e55-904e-f42ec5a2771e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:59.463866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b1cfa-6316-4e55-904e-f42ec5a2771e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:59.464766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b1cfa-6316-4e55-904e-f42ec5a2771e admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:59.465642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b1cfa-6316-4e55-904e-f42ec5a2771e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:59.467912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b1cfa-6316-4e55-904e-f42ec5a2771e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:59.572257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1094/2157] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:59 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:59.576247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748778f-2615-41fb-ade7-a7aa1636ff20 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:59.590159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748778f-2615-41fb-ade7-a7aa1636ff20 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:59.673768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c54c1d-a703-4371-93a4-4f0e0beee3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:59.674720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c54c1d-a703-4371-93a4-4f0e0beee3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:59.675104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c54c1d-a703-4371-93a4-4f0e0beee3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:59.675306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c54c1d-a703-4371-93a4-4f0e0beee3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:59.676182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c54c1d-a703-4371-93a4-4f0e0beee3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:59.678893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c54c1d-a703-4371-93a4-4f0e0beee3b1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:59.736463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1064/2158] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:59 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:59.740636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b1cfa-6316-4e55-904e-f42ec5a2771e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:59.756951 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b1cfa-6316-4e55-904e-f42ec5a2771e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:59.762085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef021f8-5348-4820-8c08-33c259ab2644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:59.762758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef021f8-5348-4820-8c08-33c259ab2644 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:59.763045 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef021f8-5348-4820-8c08-33c259ab2644 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:59.763324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef021f8-5348-4820-8c08-33c259ab2644 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:59.764136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef021f8-5348-4820-8c08-33c259ab2644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:59.765777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef021f8-5348-4820-8c08-33c259ab2644 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:59.777727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1095/2159] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:59.781931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c54c1d-a703-4371-93a4-4f0e0beee3b1 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:59.792424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c54c1d-a703-4371-93a4-4f0e0beee3b1 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:59.797355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2972f3-15c8-4dff-a7a4-debc356c9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:59.798222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2972f3-15c8-4dff-a7a4-debc356c9752 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:59.798590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2972f3-15c8-4dff-a7a4-debc356c9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:59.799100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2972f3-15c8-4dff-a7a4-debc356c9752 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:59.799929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2972f3-15c8-4dff-a7a4-debc356c9752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:59.801617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2972f3-15c8-4dff-a7a4-debc356c9752 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:59.816333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1065/2160] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:59.818060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef021f8-5348-4820-8c08-33c259ab2644 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:59.828699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef021f8-5348-4820-8c08-33c259ab2644 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:59.833668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5eaa5-4a59-48a8-a0a6-7486bbdacd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:59.839912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5eaa5-4a59-48a8-a0a6-7486bbdacd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:59.839912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5eaa5-4a59-48a8-a0a6-7486bbdacd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:59.839912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5eaa5-4a59-48a8-a0a6-7486bbdacd89 admin admin] PATH_INFO: `/v3/projects/e10be55ba3014bdea0bf759f6db96287/users/2bc2b969c6d845eeb32b5039290807df/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:59.868168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5eaa5-4a59-48a8-a0a6-7486bbdacd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10be55ba3014bdea0bf759f6db96287, user_id=2bc2b969c6d845eeb32b5039290807df, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:59.868168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5eaa5-4a59-48a8-a0a6-7486bbdacd89 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:59.923722 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1096/2161] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:59 2022] PUT /identity/v3/projects/e10be55ba3014bdea0bf759f6db96287/users/2bc2b969c6d845eeb32b5039290807df/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:59.934846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00cadf-41e2-478b-b1df-e0256a84e5ed None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:59.935078 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00cadf-41e2-478b-b1df-e0256a84e5ed None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:59.935364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00cadf-41e2-478b-b1df-e0256a84e5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:59.964611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2d00cadf-41e2-478b-b1df-e0256a84e5ed None None] MFA Rules not processed for user `2bc2b969c6d845eeb32b5039290807df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:59.965824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2d00cadf-41e2-478b-b1df-e0256a84e5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:59.980748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:00.048243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1066/2162] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:00.139935 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5eaa5-4a59-48a8-a0a6-7486bbdacd89 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:00.142917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-47c5eaa5-4a59-48a8-a0a6-7486bbdacd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:00.175080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:00.215120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5eaa5-4a59-48a8-a0a6-7486bbdacd89 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:00.218938 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7791b9-97e0-4929-a52b-b000a6c0a163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:00.219591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7791b9-97e0-4929-a52b-b000a6c0a163 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:00.219876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7791b9-97e0-4929-a52b-b000a6c0a163 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:00.220158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7791b9-97e0-4929-a52b-b000a6c0a163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:00.229511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7791b9-97e0-4929-a52b-b000a6c0a163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:00.231126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7791b9-97e0-4929-a52b-b000a6c0a163 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:00.242286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1097/2163] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:00.267478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00cadf-41e2-478b-b1df-e0256a84e5ed None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:00.334849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00cadf-41e2-478b-b1df-e0256a84e5ed None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:00.339955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:00.340832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:00.341121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:00.341419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] PATH_INFO: `/v3/users/2bc2b969c6d845eeb32b5039290807df` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:00.342603 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc2b969c6d845eeb32b5039290807df)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:00.344569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:00.559907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc2b969c6d845eeb32b5039290807df'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:00.625993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc2b969c6d845eeb32b5039290807df'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:00.626613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc2b969c6d845eeb32b5039290807df'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:00.639738 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc2b969c6d845eeb32b5039290807df'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:00.640364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc2b969c6d845eeb32b5039290807df'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:00.653402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1067/2164] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:00 2022] DELETE /identity/v3/users/2bc2b969c6d845eeb32b5039290807df => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:00.658062 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c19a6-6150-48d2-b21d-72bfa5f1318d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:00.658358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c19a6-6150-48d2-b21d-72bfa5f1318d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:00.658639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c19a6-6150-48d2-b21d-72bfa5f1318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:00.678418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7b5c19a6-6150-48d2-b21d-72bfa5f1318d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:00.679650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7b5c19a6-6150-48d2-b21d-72bfa5f1318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:00.752242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1098/2165] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:00.759977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:00.761368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:00.803240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:00.821183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d03e6-d092-4945-86b1-03024b3f6a46 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:00.824877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deacd81-ceb8-4406-99c1-a9a740749fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:00.825552 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deacd81-ceb8-4406-99c1-a9a740749fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:00.825840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deacd81-ceb8-4406-99c1-a9a740749fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:00.826153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deacd81-ceb8-4406-99c1-a9a740749fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:00.835516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deacd81-ceb8-4406-99c1-a9a740749fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:00.837446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deacd81-ceb8-4406-99c1-a9a740749fb1 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:00.848164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1068/2166] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:53:01.274804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c19a6-6150-48d2-b21d-72bfa5f1318d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:01.277170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7b5c19a6-6150-48d2-b21d-72bfa5f1318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:01.290724 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c19a6-6150-48d2-b21d-72bfa5f1318d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:01.296995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:01.298046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:01.298679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:01.298998 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] PATH_INFO: `/v3/projects/e10be55ba3014bdea0bf759f6db96287` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:01.303012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10be55ba3014bdea0bf759f6db96287)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:01.305324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:01.480758 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10be55ba3014bdea0bf759f6db96287', 'request_id': 'req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:01.569501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10be55ba3014bdea0bf759f6db96287', 'request_id': 'req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:01.578548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10be55ba3014bdea0bf759f6db96287', 'request_id': 'req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:01.593295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] The token cache is being invalidate because project e10be55ba3014bdea0bf759f6db96287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:01.593599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:01.594290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d7df8a97-e204-4c3c-90a9-fcd805d7fac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:01.595927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1099/2167] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:01 2022] DELETE /identity/v3/projects/e10be55ba3014bdea0bf759f6db96287 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:53:04.237614 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deacd81-ceb8-4406-99c1-a9a740749fb1 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:04.240640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2deacd81-ceb8-4406-99c1-a9a740749fb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:04.257879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deacd81-ceb8-4406-99c1-a9a740749fb1 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:04.408560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:04.412338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:04.416191 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:04.416697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] PATH_INFO: `/v3/users/8cddc23682ed4e8cb9e68a92d2b67d49` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:04.418959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cddc23682ed4e8cb9e68a92d2b67d49)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:04.424175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:04.705422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cddc23682ed4e8cb9e68a92d2b67d49'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.786272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cddc23682ed4e8cb9e68a92d2b67d49'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.786918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cddc23682ed4e8cb9e68a92d2b67d49'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.809641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cddc23682ed4e8cb9e68a92d2b67d49'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.810551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cddc23682ed4e8cb9e68a92d2b67d49'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.835307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1069/2168] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:04 2022] DELETE /identity/v3/users/8cddc23682ed4e8cb9e68a92d2b67d49 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:53:04.837785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07af1e-07a3-40f4-b8b1-bd8590445149 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:04.839001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07af1e-07a3-40f4-b8b1-bd8590445149 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:04.839454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07af1e-07a3-40f4-b8b1-bd8590445149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:04.869494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1e07af1e-07a3-40f4-b8b1-bd8590445149 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:04.872162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1e07af1e-07a3-40f4-b8b1-bd8590445149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:04.945753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:04.974526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1100/2169] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:04.986550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:04.989311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:05.097444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e38ca-b108-4656-86a3-a4417f77e5cb admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.107546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533af3-12c6-4558-8b16-878cf3d0d925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.108219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533af3-12c6-4558-8b16-878cf3d0d925 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.108514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533af3-12c6-4558-8b16-878cf3d0d925 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.108790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533af3-12c6-4558-8b16-878cf3d0d925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.127909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07533af3-12c6-4558-8b16-878cf3d0d925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.129374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07533af3-12c6-4558-8b16-878cf3d0d925 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.140840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:05.141017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1070/2170] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:05.646627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07af1e-07a3-40f4-b8b1-bd8590445149 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:05.648783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1e07af1e-07a3-40f4-b8b1-bd8590445149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:05.666475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07af1e-07a3-40f4-b8b1-bd8590445149 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.668484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.670236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.670713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.671221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] PATH_INFO: `/v3/projects/bc73ec35b8114013970d16321c7020d5` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.673306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc73ec35b8114013970d16321c7020d5)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.675580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.815375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc73ec35b8114013970d16321c7020d5', 'request_id': 'req-78dac0c5-032a-49f6-a154-4212a13c0b68'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.940872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc73ec35b8114013970d16321c7020d5', 'request_id': 'req-78dac0c5-032a-49f6-a154-4212a13c0b68'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.948303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc73ec35b8114013970d16321c7020d5', 'request_id': 'req-78dac0c5-032a-49f6-a154-4212a13c0b68'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.959654 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] The token cache is being invalidate because project bc73ec35b8114013970d16321c7020d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:05.959940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.960808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-78dac0c5-032a-49f6-a154-4212a13c0b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.963105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1101/2171] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:05 2022] DELETE /identity/v3/projects/bc73ec35b8114013970d16321c7020d5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:05.968034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ab5c2-e195-4b67-b653-5f15f72b52e5 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.968884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ab5c2-e195-4b67-b653-5f15f72b52e5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.969166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ab5c2-e195-4b67-b653-5f15f72b52e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.992360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-980ab5c2-e195-4b67-b653-5f15f72b52e5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:05.993372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-980ab5c2-e195-4b67-b653-5f15f72b52e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:06.058265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1071/2172] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:53:06.066501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c2f03-0c7e-41c8-8437-38d4ad40378b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:06.066865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c2f03-0c7e-41c8-8437-38d4ad40378b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:06.067213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c2f03-0c7e-41c8-8437-38d4ad40378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:06.087458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a75c2f03-0c7e-41c8-8437-38d4ad40378b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:06.089745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a75c2f03-0c7e-41c8-8437-38d4ad40378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:06.097524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1102/2173] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:53:06.103868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ab5c2-e195-4b67-b653-5f15f72b52e5 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:06.116473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ab5c2-e195-4b67-b653-5f15f72b52e5 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:06.120508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2059fcc-768a-4bc1-a972-c469d801812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:06.121428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2059fcc-768a-4bc1-a972-c469d801812a admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:06.121716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2059fcc-768a-4bc1-a972-c469d801812a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:06.122029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2059fcc-768a-4bc1-a972-c469d801812a admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:06.122779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2059fcc-768a-4bc1-a972-c469d801812a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:53:06.123095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2059fcc-768a-4bc1-a972-c469d801812a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:06.124705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2059fcc-768a-4bc1-a972-c469d801812a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:06.141997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1072/2174] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:53:06.145556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c2f03-0c7e-41c8-8437-38d4ad40378b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:06.155517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c2f03-0c7e-41c8-8437-38d4ad40378b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:06.162874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa592ef1-7054-410f-8207-5ed10176ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:06.163614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa592ef1-7054-410f-8207-5ed10176ff19 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:06.163964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa592ef1-7054-410f-8207-5ed10176ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:06.164314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa592ef1-7054-410f-8207-5ed10176ff19 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:06.165099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa592ef1-7054-410f-8207-5ed10176ff19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:06.167190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa592ef1-7054-410f-8207-5ed10176ff19 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:06.284668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1103/2175] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:53:06 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:06.287981 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2059fcc-768a-4bc1-a972-c469d801812a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:06.299006 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2059fcc-768a-4bc1-a972-c469d801812a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:06.370093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5332dcf-dc4a-4472-9d07-758c0a41e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:06.370795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5332dcf-dc4a-4472-9d07-758c0a41e8cb admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:06.371079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5332dcf-dc4a-4472-9d07-758c0a41e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:06.373639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5332dcf-dc4a-4472-9d07-758c0a41e8cb admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:06.373639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5332dcf-dc4a-4472-9d07-758c0a41e8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:06.374107 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5332dcf-dc4a-4472-9d07-758c0a41e8cb admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:06.497560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1073/2176] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:53:06 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:06.504012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa592ef1-7054-410f-8207-5ed10176ff19 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:06.516876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa592ef1-7054-410f-8207-5ed10176ff19 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:06.522411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42c6c3-b4c8-4d1d-87fa-da656f94a0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:06.523082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42c6c3-b4c8-4d1d-87fa-da656f94a0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:06.523624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42c6c3-b4c8-4d1d-87fa-da656f94a0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:06.524100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42c6c3-b4c8-4d1d-87fa-da656f94a0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:06.524844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42c6c3-b4c8-4d1d-87fa-da656f94a0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:06.526678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42c6c3-b4c8-4d1d-87fa-da656f94a0c9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:06.537501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1104/2177] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:06.542589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5332dcf-dc4a-4472-9d07-758c0a41e8cb admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:06.553923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5332dcf-dc4a-4472-9d07-758c0a41e8cb admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:06.565130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647160d-727c-4dcc-909f-eb2caef1a222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:06.565823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647160d-727c-4dcc-909f-eb2caef1a222 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:06.566147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647160d-727c-4dcc-909f-eb2caef1a222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:06.570135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647160d-727c-4dcc-909f-eb2caef1a222 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:06.570135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647160d-727c-4dcc-909f-eb2caef1a222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:06.570135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647160d-727c-4dcc-909f-eb2caef1a222 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:06.581204 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1074/2178] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:06.585771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42c6c3-b4c8-4d1d-87fa-da656f94a0c9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:06.600042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42c6c3-b4c8-4d1d-87fa-da656f94a0c9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:06.600741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190f588-b2ce-433b-8af1-e22ebd09a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:06.601663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f588-b2ce-433b-8af1-e22ebd09a0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:06.601963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f588-b2ce-433b-8af1-e22ebd09a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:06.602276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f588-b2ce-433b-8af1-e22ebd09a0cd admin admin] PATH_INFO: `/v3/projects/4a5009bb20db43dd8ae068ff2fbf1855/users/247babcfc4e249c4adeabbe2f243a37c/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:06.619638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190f588-b2ce-433b-8af1-e22ebd09a0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5009bb20db43dd8ae068ff2fbf1855, user_id=247babcfc4e249c4adeabbe2f243a37c, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:06.622409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190f588-b2ce-433b-8af1-e22ebd09a0cd admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:06.689611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1105/2179] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:53:06 2022] PUT /identity/v3/projects/4a5009bb20db43dd8ae068ff2fbf1855/users/247babcfc4e249c4adeabbe2f243a37c/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:06.695111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b923f13-354c-4eb2-9698-147064e1d2df None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:06.695445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b923f13-354c-4eb2-9698-147064e1d2df None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:06.695731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b923f13-354c-4eb2-9698-147064e1d2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:06.727816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3b923f13-354c-4eb2-9698-147064e1d2df None None] MFA Rules not processed for user `247babcfc4e249c4adeabbe2f243a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:06.729291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3b923f13-354c-4eb2-9698-147064e1d2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:06.796118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:06.812232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1075/2180] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:06.826714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190f588-b2ce-433b-8af1-e22ebd09a0cd admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:06.830443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1190f588-b2ce-433b-8af1-e22ebd09a0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:06.900519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190f588-b2ce-433b-8af1-e22ebd09a0cd admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:06.904478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0119bd4-7464-4e10-a6e9-fa176dae3e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:06.905232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0119bd4-7464-4e10-a6e9-fa176dae3e15 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:06.905522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0119bd4-7464-4e10-a6e9-fa176dae3e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:06.905797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0119bd4-7464-4e10-a6e9-fa176dae3e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:06.918236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0119bd4-7464-4e10-a6e9-fa176dae3e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:06.919820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0119bd4-7464-4e10-a6e9-fa176dae3e15 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:06.930186 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1106/2181] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:07.222470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed276c7-4174-4f1a-a1cb-7d7d1bbbe099 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:07.223035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed276c7-4174-4f1a-a1cb-7d7d1bbbe099 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:07.224127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed276c7-4174-4f1a-a1cb-7d7d1bbbe099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:07.244662 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4ed276c7-4174-4f1a-a1cb-7d7d1bbbe099 None None] MFA Rules not processed for user `52599ae5d7a045e6b6156352322e5642`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:07.245864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4ed276c7-4174-4f1a-a1cb-7d7d1bbbe099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:07.315991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1076/2182] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:09.706708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1a87-2275-4ff9-a77a-a623254ab1ca None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:09.707104 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1a87-2275-4ff9-a77a-a623254ab1ca None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:09.707397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1a87-2275-4ff9-a77a-a623254ab1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:09.725772 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-fa3f1a87-2275-4ff9-a77a-a623254ab1ca None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:09.728185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fa3f1a87-2275-4ff9-a77a-a623254ab1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:09.739731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:09.827621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1107/2183] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:09.889858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed276c7-4174-4f1a-a1cb-7d7d1bbbe099 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:09.891892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4ed276c7-4174-4f1a-a1cb-7d7d1bbbe099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:09.968795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed276c7-4174-4f1a-a1cb-7d7d1bbbe099 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:09.973705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f5401-4002-4b0d-8123-847612bc68e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:09.974534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f5401-4002-4b0d-8123-847612bc68e0 service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:09.974857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f5401-4002-4b0d-8123-847612bc68e0 service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:09.975133 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f5401-4002-4b0d-8123-847612bc68e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:09.984301 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f5401-4002-4b0d-8123-847612bc68e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:09.985977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f5401-4002-4b0d-8123-847612bc68e0 service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:09.994442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1077/2184] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:53:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:53:10.181302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f1a87-2275-4ff9-a77a-a623254ab1ca None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:10.282427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f1a87-2275-4ff9-a77a-a623254ab1ca None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:10.288715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:10.289604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:10.289961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:10.290337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] PATH_INFO: `/v3/users/247babcfc4e249c4adeabbe2f243a37c` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:10.291780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247babcfc4e249c4adeabbe2f243a37c)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:10.293744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:10.520339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247babcfc4e249c4adeabbe2f243a37c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:10.591946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247babcfc4e249c4adeabbe2f243a37c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:10.608378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247babcfc4e249c4adeabbe2f243a37c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:10.609171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247babcfc4e249c4adeabbe2f243a37c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:10.624119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247babcfc4e249c4adeabbe2f243a37c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:10.633129 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1108/2185] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:10 2022] DELETE /identity/v3/users/247babcfc4e249c4adeabbe2f243a37c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:10.638282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f519b-1979-4cd5-b550-67977b146db5 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:10.638578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f519b-1979-4cd5-b550-67977b146db5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:10.638861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f519b-1979-4cd5-b550-67977b146db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:10.663559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e56f519b-1979-4cd5-b550-67977b146db5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:10.672121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e56f519b-1979-4cd5-b550-67977b146db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:10.780855 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1078/2186] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:53:10.790537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:10.792084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:10.858305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:10.877552 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3c7a1-2c60-4ec0-bd25-8a00dc62bdc7 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:10.882650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f73b51-d2b7-4bba-b738-af25de635aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:10.883378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f73b51-d2b7-4bba-b738-af25de635aeb service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:10.883807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f73b51-d2b7-4bba-b738-af25de635aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:10.884159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f73b51-d2b7-4bba-b738-af25de635aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:10.925731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f73b51-d2b7-4bba-b738-af25de635aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:10.928665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f73b51-d2b7-4bba-b738-af25de635aeb service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:10.940449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1109/2187] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:12.209552 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f519b-1979-4cd5-b550-67977b146db5 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:12.211323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e56f519b-1979-4cd5-b550-67977b146db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:12.261017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f519b-1979-4cd5-b550-67977b146db5 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:12.267581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:12.268572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:12.268934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:12.269359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] PATH_INFO: `/v3/projects/4a5009bb20db43dd8ae068ff2fbf1855` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:12.270818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5009bb20db43dd8ae068ff2fbf1855)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:12.273075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:12.415829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:12.450851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5009bb20db43dd8ae068ff2fbf1855', 'request_id': 'req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:12.461770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5009bb20db43dd8ae068ff2fbf1855', 'request_id': 'req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:12.540089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5009bb20db43dd8ae068ff2fbf1855', 'request_id': 'req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:12.572758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] The token cache is being invalidate because project 4a5009bb20db43dd8ae068ff2fbf1855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:12.574272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:12.575438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-17fb750e-eb0f-469e-9c84-ca6edaeb2cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:12.577696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1079/2188] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:12 2022] DELETE /identity/v3/projects/4a5009bb20db43dd8ae068ff2fbf1855 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:12.583150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedc723-c02d-4fe0-8e65-b56b8c726011 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:12.583662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedc723-c02d-4fe0-8e65-b56b8c726011 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:12.583950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedc723-c02d-4fe0-8e65-b56b8c726011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:12.607052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3eedc723-c02d-4fe0-8e65-b56b8c726011 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:12.610539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3eedc723-c02d-4fe0-8e65-b56b8c726011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:12.734046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d26f-0244-426f-b7aa-a069e3dac466 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:12.734481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d26f-0244-426f-b7aa-a069e3dac466 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:12.734864 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d26f-0244-426f-b7aa-a069e3dac466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:12.736400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1110/2189] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:12.761248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-11e9d26f-0244-426f-b7aa-a069e3dac466 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:12.762650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-11e9d26f-0244-426f-b7aa-a069e3dac466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:12.778346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1080/2190] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:12.779171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedc723-c02d-4fe0-8e65-b56b8c726011 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:12.813493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedc723-c02d-4fe0-8e65-b56b8c726011 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:12.831749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3e59f-1b68-48bc-b4f0-27361ecc42ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:12.831749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e59f-1b68-48bc-b4f0-27361ecc42ca admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:12.831749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e59f-1b68-48bc-b4f0-27361ecc42ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:12.831749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e59f-1b68-48bc-b4f0-27361ecc42ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:12.833091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3e59f-1b68-48bc-b4f0-27361ecc42ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:53:12.833091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3e59f-1b68-48bc-b4f0-27361ecc42ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:12.833740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3e59f-1b68-48bc-b4f0-27361ecc42ca admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:12.850533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1111/2191] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:53:12.855176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d26f-0244-426f-b7aa-a069e3dac466 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:12.866992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d26f-0244-426f-b7aa-a069e3dac466 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:12.880018 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d031-6a4c-4024-a574-b1bc5e851522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:12.881478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d031-6a4c-4024-a574-b1bc5e851522 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:12.881775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d031-6a4c-4024-a574-b1bc5e851522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:12.882901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d031-6a4c-4024-a574-b1bc5e851522 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:12.883713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d031-6a4c-4024-a574-b1bc5e851522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:12.886648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d031-6a4c-4024-a574-b1bc5e851522 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:13.011264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1081/2192] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:53:12 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:53:13.012723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3e59f-1b68-48bc-b4f0-27361ecc42ca admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:13.029101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3e59f-1b68-48bc-b4f0-27361ecc42ca admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:13.189221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cd519-89e9-4345-a940-f1d7aca5bda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:13.190448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cd519-89e9-4345-a940-f1d7aca5bda5 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:13.190963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cd519-89e9-4345-a940-f1d7aca5bda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:13.191460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cd519-89e9-4345-a940-f1d7aca5bda5 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:13.192947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cd519-89e9-4345-a940-f1d7aca5bda5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:13.196260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cd519-89e9-4345-a940-f1d7aca5bda5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:13.323858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1112/2193] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:53:13 2022] POST /identity/v3/users => generated 283 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:13.328219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d031-6a4c-4024-a574-b1bc5e851522 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:13.342501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d031-6a4c-4024-a574-b1bc5e851522 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:13.350644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c3727-ae07-43ae-bd16-9eafca02cb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:13.351324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3727-ae07-43ae-bd16-9eafca02cb42 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:13.351628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3727-ae07-43ae-bd16-9eafca02cb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:13.351922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3727-ae07-43ae-bd16-9eafca02cb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:13.352669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c3727-ae07-43ae-bd16-9eafca02cb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:13.354397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c3727-ae07-43ae-bd16-9eafca02cb42 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:13.366832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1082/2194] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:13.370903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cd519-89e9-4345-a940-f1d7aca5bda5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:13.393046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cd519-89e9-4345-a940-f1d7aca5bda5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:13.404518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c56b7-a3aa-45f3-9812-cf74cf3d62d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:13.405727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c56b7-a3aa-45f3-9812-cf74cf3d62d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:13.407624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c56b7-a3aa-45f3-9812-cf74cf3d62d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:13.407768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c56b7-a3aa-45f3-9812-cf74cf3d62d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:13.408631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c56b7-a3aa-45f3-9812-cf74cf3d62d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:13.412929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c56b7-a3aa-45f3-9812-cf74cf3d62d1 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:13.427596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1113/2195] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:13.428595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c3727-ae07-43ae-bd16-9eafca02cb42 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:13.438854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c3727-ae07-43ae-bd16-9eafca02cb42 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:13.443679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0bc11-85dd-4a3c-8e38-a10c77e390f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:13.444570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0bc11-85dd-4a3c-8e38-a10c77e390f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:13.444860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0bc11-85dd-4a3c-8e38-a10c77e390f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:13.445145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0bc11-85dd-4a3c-8e38-a10c77e390f2 admin admin] PATH_INFO: `/v3/projects/47932c77de83419090a9f7206b14999f/users/90a3a1357ed54ee984283cb3edb73412/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:13.466232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0bc11-85dd-4a3c-8e38-a10c77e390f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47932c77de83419090a9f7206b14999f, user_id=90a3a1357ed54ee984283cb3edb73412, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:13.469040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0bc11-85dd-4a3c-8e38-a10c77e390f2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:13.563393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1083/2196] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:53:13 2022] PUT /identity/v3/projects/47932c77de83419090a9f7206b14999f/users/90a3a1357ed54ee984283cb3edb73412/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:53:13.574563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d945b-9e8e-4a99-85e8-9ccba467c394 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:13.576626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d945b-9e8e-4a99-85e8-9ccba467c394 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:13.576626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d945b-9e8e-4a99-85e8-9ccba467c394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:13.610223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3f1d945b-9e8e-4a99-85e8-9ccba467c394 None None] MFA Rules not processed for user `90a3a1357ed54ee984283cb3edb73412`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:13.611762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3f1d945b-9e8e-4a99-85e8-9ccba467c394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:13.661808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:13.709467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1114/2197] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:13.717304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0bc11-85dd-4a3c-8e38-a10c77e390f2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:13.719075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9ef0bc11-85dd-4a3c-8e38-a10c77e390f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:13.791973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0bc11-85dd-4a3c-8e38-a10c77e390f2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:13.797123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ed9eb-0553-40eb-9854-31fa66826008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:13.798029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ed9eb-0553-40eb-9854-31fa66826008 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:13.798319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ed9eb-0553-40eb-9854-31fa66826008 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:13.798620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ed9eb-0553-40eb-9854-31fa66826008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:13.811580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ed9eb-0553-40eb-9854-31fa66826008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:13.813209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ed9eb-0553-40eb-9854-31fa66826008 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:13.846615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1084/2198] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:53:21.401071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08abb-2dd1-4777-bf43-9ce4b4a0f3ee None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:21.401604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08abb-2dd1-4777-bf43-9ce4b4a0f3ee None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:21.401604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08abb-2dd1-4777-bf43-9ce4b4a0f3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:21.448302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-34c08abb-2dd1-4777-bf43-9ce4b4a0f3ee None None] MFA Rules not processed for user `60622199be2e44cd9c72f37c9d41e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:21.450199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-34c08abb-2dd1-4777-bf43-9ce4b4a0f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:21.578306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1115/2199] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:23.834728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:31.579116 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=48 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:31.933326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913c41e-eab3-418d-96ae-d0bf63ba99e8 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:31.933852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913c41e-eab3-418d-96ae-d0bf63ba99e8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:31.933974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913c41e-eab3-418d-96ae-d0bf63ba99e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:31.966249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f913c41e-eab3-418d-96ae-d0bf63ba99e8 None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:31.967761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f913c41e-eab3-418d-96ae-d0bf63ba99e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:32.092437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c08abb-2dd1-4777-bf43-9ce4b4a0f3ee None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:32.093532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1085/2200] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:53:32.094189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-34c08abb-2dd1-4777-bf43-9ce4b4a0f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:32.269694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c08abb-2dd1-4777-bf43-9ce4b4a0f3ee None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:32.275288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc6ee5-d9d7-4ce3-bfc4-cc528c7ea8be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:32.276847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc6ee5-d9d7-4ce3-bfc4-cc528c7ea8be service swift] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:32.277343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc6ee5-d9d7-4ce3-bfc4-cc528c7ea8be service swift] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:32.277782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc6ee5-d9d7-4ce3-bfc4-cc528c7ea8be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:32.290502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc6ee5-d9d7-4ce3-bfc4-cc528c7ea8be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:32.292916 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc6ee5-d9d7-4ce3-bfc4-cc528c7ea8be service swift] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:32.312812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1116/2201] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:53:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:53:39.851101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913c41e-eab3-418d-96ae-d0bf63ba99e8 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:39.853925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f913c41e-eab3-418d-96ae-d0bf63ba99e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:39.948936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913c41e-eab3-418d-96ae-d0bf63ba99e8 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:39.952961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7a591-9ba9-4d29-ad4f-c25f1e8d0081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:39.958071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7a591-9ba9-4d29-ad4f-c25f1e8d0081 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:39.958621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7a591-9ba9-4d29-ad4f-c25f1e8d0081 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:39.958978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7a591-9ba9-4d29-ad4f-c25f1e8d0081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:39.960963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2df7a591-9ba9-4d29-ad4f-c25f1e8d0081 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:40.064262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7a591-9ba9-4d29-ad4f-c25f1e8d0081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:40.066064 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7a591-9ba9-4d29-ad4f-c25f1e8d0081 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:40.079094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1086/2202] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:42.300362 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=35 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:44.320002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567398-0fce-4fcc-b86a-7c7131827efe None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:44.320002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567398-0fce-4fcc-b86a-7c7131827efe None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:44.320002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567398-0fce-4fcc-b86a-7c7131827efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:44.351516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-c4567398-0fce-4fcc-b86a-7c7131827efe None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:44.354342 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c4567398-0fce-4fcc-b86a-7c7131827efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:44.398425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1117/2203] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:44.442447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7a591-9ba9-4d29-ad4f-c25f1e8d0081 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:44.460193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7a591-9ba9-4d29-ad4f-c25f1e8d0081 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:44.473158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886cb8-c8c3-43f7-b22e-d0f429d3ab24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:44.474416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886cb8-c8c3-43f7-b22e-d0f429d3ab24 service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:44.474880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886cb8-c8c3-43f7-b22e-d0f429d3ab24 service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:44.475329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886cb8-c8c3-43f7-b22e-d0f429d3ab24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:44.496611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51886cb8-c8c3-43f7-b22e-d0f429d3ab24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:44.498318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51886cb8-c8c3-43f7-b22e-d0f429d3ab24 service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:44.507234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:44.521389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1087/2204] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:53:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:53:47.745891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567398-0fce-4fcc-b86a-7c7131827efe None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:47.747588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c4567398-0fce-4fcc-b86a-7c7131827efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:47.849034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567398-0fce-4fcc-b86a-7c7131827efe None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:47.853677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:47.854574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:47.854863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:47.855143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] PATH_INFO: `/v3/users/b7352f61af2241b0babedb2000f7de17` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:47.856585 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7352f61af2241b0babedb2000f7de17)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:47.858319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:48.066118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7352f61af2241b0babedb2000f7de17'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.132582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7352f61af2241b0babedb2000f7de17'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.147357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7352f61af2241b0babedb2000f7de17'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.147357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7352f61af2241b0babedb2000f7de17'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.153607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3198837f-95b5-449b-99ab-a6e80fcafdc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7352f61af2241b0babedb2000f7de17'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.160142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1118/2205] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:47 2022] DELETE /identity/v3/users/b7352f61af2241b0babedb2000f7de17 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:48.402989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886cb8-c8c3-43f7-b22e-d0f429d3ab24 service swift] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:48.416590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886cb8-c8c3-43f7-b22e-d0f429d3ab24 service swift] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:48.476356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:48.477272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:48.477555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:48.477836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] PATH_INFO: `/v3/projects/f54bc2e94a2b46fbace5f5745bc15cdd` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:48.479037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54bc2e94a2b46fbace5f5745bc15cdd)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:48.481038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:48.590287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54bc2e94a2b46fbace5f5745bc15cdd', 'request_id': 'req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.596950 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54bc2e94a2b46fbace5f5745bc15cdd', 'request_id': 'req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.670410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54bc2e94a2b46fbace5f5745bc15cdd', 'request_id': 'req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.683222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] The token cache is being invalidate because project f54bc2e94a2b46fbace5f5745bc15cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:48.683515 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.684150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-88fe7bc9-b063-4da0-b1d4-0e93f407fcd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.685817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1088/2206] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:48 2022] DELETE /identity/v3/projects/f54bc2e94a2b46fbace5f5745bc15cdd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:48.691452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2f8e6-c0e7-462e-b604-a2449c8cc90a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:48.691746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2f8e6-c0e7-462e-b604-a2449c8cc90a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:48.692031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2f8e6-c0e7-462e-b604-a2449c8cc90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:48.746576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:48.749618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d6c2f8e6-c0e7-462e-b604-a2449c8cc90a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:48.751033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d6c2f8e6-c0e7-462e-b604-a2449c8cc90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:48.811962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1119/2207] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:48.820281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73216ff1-2121-4a75-bc77-e278b36c6371 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:48.820572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73216ff1-2121-4a75-bc77-e278b36c6371 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:48.820852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73216ff1-2121-4a75-bc77-e278b36c6371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:48.839406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-73216ff1-2121-4a75-bc77-e278b36c6371 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:48.842464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-73216ff1-2121-4a75-bc77-e278b36c6371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:48.848695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1089/2208] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:48.853206 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2f8e6-c0e7-462e-b604-a2449c8cc90a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:48.863417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2f8e6-c0e7-462e-b604-a2449c8cc90a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:48.868046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79ca2-02a5-4bbd-bc50-2a7bb4e18a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:48.868711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79ca2-02a5-4bbd-bc50-2a7bb4e18a7c admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:48.868999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79ca2-02a5-4bbd-bc50-2a7bb4e18a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:48.869309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79ca2-02a5-4bbd-bc50-2a7bb4e18a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:48.870076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79ca2-02a5-4bbd-bc50-2a7bb4e18a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:53:48.870392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79ca2-02a5-4bbd-bc50-2a7bb4e18a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:48.872018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79ca2-02a5-4bbd-bc50-2a7bb4e18a7c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:48.894286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1120/2209] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:53:48.897048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73216ff1-2121-4a75-bc77-e278b36c6371 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:48.914696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73216ff1-2121-4a75-bc77-e278b36c6371 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:48.920887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e980d29-1b75-4c0f-be6b-da0ba228ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:48.921596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980d29-1b75-4c0f-be6b-da0ba228ae59 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:48.921990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980d29-1b75-4c0f-be6b-da0ba228ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:48.922326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980d29-1b75-4c0f-be6b-da0ba228ae59 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:48.923090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e980d29-1b75-4c0f-be6b-da0ba228ae59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:48.925738 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e980d29-1b75-4c0f-be6b-da0ba228ae59 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:48.991572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1090/2210] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:53:48 2022] POST /identity/v3/projects => generated 397 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:48.996035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79ca2-02a5-4bbd-bc50-2a7bb4e18a7c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.006536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79ca2-02a5-4bbd-bc50-2a7bb4e18a7c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.065046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a0346-b00c-42df-9420-272ebfd19a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.065680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a0346-b00c-42df-9420-272ebfd19a53 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.066003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a0346-b00c-42df-9420-272ebfd19a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.066290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a0346-b00c-42df-9420-272ebfd19a53 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.067068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a0346-b00c-42df-9420-272ebfd19a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.069229 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a0346-b00c-42df-9420-272ebfd19a53 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.130560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1121/2211] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:53:48 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:49.131760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e980d29-1b75-4c0f-be6b-da0ba228ae59 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.142447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e980d29-1b75-4c0f-be6b-da0ba228ae59 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.147373 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835dafa-c495-4cab-a25e-ccb8cf716f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.147980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835dafa-c495-4cab-a25e-ccb8cf716f77 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.149789 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835dafa-c495-4cab-a25e-ccb8cf716f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.150127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835dafa-c495-4cab-a25e-ccb8cf716f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.150906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835dafa-c495-4cab-a25e-ccb8cf716f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.156839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835dafa-c495-4cab-a25e-ccb8cf716f77 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.166477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1091/2212] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:49.170551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a0346-b00c-42df-9420-272ebfd19a53 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.182987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a0346-b00c-42df-9420-272ebfd19a53 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.187952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffd9ea-6ca5-44e6-8b9f-88c437cc4816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.188621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffd9ea-6ca5-44e6-8b9f-88c437cc4816 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.188906 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffd9ea-6ca5-44e6-8b9f-88c437cc4816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.189248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffd9ea-6ca5-44e6-8b9f-88c437cc4816 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.190782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffd9ea-6ca5-44e6-8b9f-88c437cc4816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.192379 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffd9ea-6ca5-44e6-8b9f-88c437cc4816 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.203613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1122/2213] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:49.209703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835dafa-c495-4cab-a25e-ccb8cf716f77 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.220367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835dafa-c495-4cab-a25e-ccb8cf716f77 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.225097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9050-70a7-4eec-864a-bfaa4e43d133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.226038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9050-70a7-4eec-864a-bfaa4e43d133 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.226334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9050-70a7-4eec-864a-bfaa4e43d133 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.226611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9050-70a7-4eec-864a-bfaa4e43d133 admin admin] PATH_INFO: `/v3/projects/b3892d27ebf947f3ad9522a6484e19e9/users/91969c7fff0941e1858c53ddd2c60d57/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.246085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9050-70a7-4eec-864a-bfaa4e43d133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3892d27ebf947f3ad9522a6484e19e9, user_id=91969c7fff0941e1858c53ddd2c60d57, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.248858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9050-70a7-4eec-864a-bfaa4e43d133 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.333795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1092/2214] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:53:49 2022] PUT /identity/v3/projects/b3892d27ebf947f3ad9522a6484e19e9/users/91969c7fff0941e1858c53ddd2c60d57/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:49.400438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf8c17-2986-4d07-b003-0ad8f6bd905a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.400887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf8c17-2986-4d07-b003-0ad8f6bd905a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.401173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf8c17-2986-4d07-b003-0ad8f6bd905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.441830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-6fdf8c17-2986-4d07-b003-0ad8f6bd905a None None] MFA Rules not processed for user `91969c7fff0941e1858c53ddd2c60d57`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:49.443126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6fdf8c17-2986-4d07-b003-0ad8f6bd905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:49.523559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1123/2215] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:49.535932 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9050-70a7-4eec-864a-bfaa4e43d133 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.537673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-853f9050-70a7-4eec-864a-bfaa4e43d133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:49.565206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:49.621277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9050-70a7-4eec-864a-bfaa4e43d133 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.624992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411fda-6b10-4295-a35f-acad3d50c7a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.625700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411fda-6b10-4295-a35f-acad3d50c7a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.626370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411fda-6b10-4295-a35f-acad3d50c7a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.626898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411fda-6b10-4295-a35f-acad3d50c7a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.636223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411fda-6b10-4295-a35f-acad3d50c7a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.637725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411fda-6b10-4295-a35f-acad3d50c7a1 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.647465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1093/2216] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:50.832642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d89c8-b368-4064-ac70-9853bd2130f5 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:50.833197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d89c8-b368-4064-ac70-9853bd2130f5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:50.833197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d89c8-b368-4064-ac70-9853bd2130f5 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:50.834925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1124/2217] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:53:50.840899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8809408-0230-4ab0-bfd0-ef2b3de698f8 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:50.841385 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8809408-0230-4ab0-bfd0-ef2b3de698f8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:50.841483 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8809408-0230-4ab0-bfd0-ef2b3de698f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:50.889906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a8809408-0230-4ab0-bfd0-ef2b3de698f8 None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:50.891323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a8809408-0230-4ab0-bfd0-ef2b3de698f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:50.966342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1094/2218] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:50.978314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d89c8-b368-4064-ac70-9853bd2130f5 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:50.980091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-aa3d89c8-b368-4064-ac70-9853bd2130f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:50.985962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:51.041573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d89c8-b368-4064-ac70-9853bd2130f5 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:51.045245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f984cfe-2450-4dee-b57b-59c2cd6ce01b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e839d1074f24a5ba7a552472e167067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:51.045894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984cfe-2450-4dee-b57b-59c2cd6ce01b service glance] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:51.046331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984cfe-2450-4dee-b57b-59c2cd6ce01b service glance] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:51.046643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984cfe-2450-4dee-b57b-59c2cd6ce01b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:51.062300 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f984cfe-2450-4dee-b57b-59c2cd6ce01b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:51.066719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f984cfe-2450-4dee-b57b-59c2cd6ce01b service glance] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:51.075121 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1125/2219] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:51.289381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2160e37-0672-43ab-b289-f1f869ae3901 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:51.289676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2160e37-0672-43ab-b289-f1f869ae3901 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:51.290008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2160e37-0672-43ab-b289-f1f869ae3901 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:51.291424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1095/2220] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:53:51.297383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfdc71-aad1-49b8-a4bf-0c21b4784de6 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:51.297682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfdc71-aad1-49b8-a4bf-0c21b4784de6 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:51.299786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfdc71-aad1-49b8-a4bf-0c21b4784de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:51.320482 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a5dfdc71-aad1-49b8-a4bf-0c21b4784de6 None None] MFA Rules not processed for user `719afb6dcb154119beb18d2f1974fe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:51.321715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a5dfdc71-aad1-49b8-a4bf-0c21b4784de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:51.383075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1126/2221] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:51.395645 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2160e37-0672-43ab-b289-f1f869ae3901 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:51.397305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f2160e37-0672-43ab-b289-f1f869ae3901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:51.410586 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2160e37-0672-43ab-b289-f1f869ae3901 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:51.414219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57d762-9215-4fc3-85e2-c0cf68307a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:51.414882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57d762-9215-4fc3-85e2-c0cf68307a92 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:51.415171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57d762-9215-4fc3-85e2-c0cf68307a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:51.415446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57d762-9215-4fc3-85e2-c0cf68307a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:51.423038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57d762-9215-4fc3-85e2-c0cf68307a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:51.424477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57d762-9215-4fc3-85e2-c0cf68307a92 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:51.432342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1096/2222] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:51.513880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb4238-8ee9-4693-abb6-cb582d2ad574 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:51.514205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb4238-8ee9-4693-abb6-cb582d2ad574 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:51.514500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb4238-8ee9-4693-abb6-cb582d2ad574 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:51.515872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1127/2223] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:53:51.521919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288b992-68af-4bc8-bc6c-a03f1b2a973d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:51.522248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288b992-68af-4bc8-bc6c-a03f1b2a973d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:51.522535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288b992-68af-4bc8-bc6c-a03f1b2a973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:51.541232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3288b992-68af-4bc8-bc6c-a03f1b2a973d None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:51.542479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3288b992-68af-4bc8-bc6c-a03f1b2a973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:51.553666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1097/2224] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:51.566874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb4238-8ee9-4693-abb6-cb582d2ad574 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:51.578119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb4238-8ee9-4693-abb6-cb582d2ad574 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:51.581972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca8ff8-60c7-4798-8317-ab5246cedc71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:51.582602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca8ff8-60c7-4798-8317-ab5246cedc71 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:51.582937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca8ff8-60c7-4798-8317-ab5246cedc71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:51.583219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca8ff8-60c7-4798-8317-ab5246cedc71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:51.596331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca8ff8-60c7-4798-8317-ab5246cedc71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:51.598311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca8ff8-60c7-4798-8317-ab5246cedc71 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:51.618231 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1128/2225] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:55.134707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c3a2-5140-4c56-9225-0609eb83306b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:55.135220 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c3a2-5140-4c56-9225-0609eb83306b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:55.135334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c3a2-5140-4c56-9225-0609eb83306b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:55.153497 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6ed5c3a2-5140-4c56-9225-0609eb83306b None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:55.154779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6ed5c3a2-5140-4c56-9225-0609eb83306b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:55.197908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:55.209433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca8ff8-60c7-4798-8317-ab5246cedc71 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:55.211033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-48ca8ff8-60c7-4798-8317-ab5246cedc71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:55.214325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1098/2226] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:55.227008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5c3a2-5140-4c56-9225-0609eb83306b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:55.228450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6ed5c3a2-5140-4c56-9225-0609eb83306b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:55.279152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca8ff8-60c7-4798-8317-ab5246cedc71 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:55.284868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:55.285768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:55.290181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:55.290181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] PATH_INFO: `/v3/users/90a3a1357ed54ee984283cb3edb73412` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:55.290181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a3a1357ed54ee984283cb3edb73412)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:55.290181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:55.300356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5c3a2-5140-4c56-9225-0609eb83306b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:55.307141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1301cf-5e1a-42c0-a396-9561ccf07c8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:55.307794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1301cf-5e1a-42c0-a396-9561ccf07c8d service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:55.308103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1301cf-5e1a-42c0-a396-9561ccf07c8d service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:55.313145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1301cf-5e1a-42c0-a396-9561ccf07c8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:55.317690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1301cf-5e1a-42c0-a396-9561ccf07c8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:55.319317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1301cf-5e1a-42c0-a396-9561ccf07c8d service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:55.327310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1099/2227] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:53:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:53:55.542824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:55.549236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a3a1357ed54ee984283cb3edb73412'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.608540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a3a1357ed54ee984283cb3edb73412'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.624492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a3a1357ed54ee984283cb3edb73412'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.625447 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a3a1357ed54ee984283cb3edb73412'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.633676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a3a1357ed54ee984283cb3edb73412'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.641493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1129/2228] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:55 2022] DELETE /identity/v3/users/90a3a1357ed54ee984283cb3edb73412 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:55.646385 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2bb62-1428-4252-840f-9a8f0165c228 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:55.646685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2bb62-1428-4252-840f-9a8f0165c228 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:55.646966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2bb62-1428-4252-840f-9a8f0165c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:55.674080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-28b2bb62-1428-4252-840f-9a8f0165c228 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:55.677094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-28b2bb62-1428-4252-840f-9a8f0165c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:55.726998 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:55.728958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:55.781750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1100/2229] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:55.793466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2bb62-1428-4252-840f-9a8f0165c228 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:55.795696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-28b2bb62-1428-4252-840f-9a8f0165c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:55.818352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86962d-1353-43c5-9d59-aca090b2be62 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:55.825324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:55.826694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:55.827155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:55.828564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] PATH_INFO: `/v3/users/91969c7fff0941e1858c53ddd2c60d57` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:55.830255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91969c7fff0941e1858c53ddd2c60d57)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:55.835516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:55.880092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2bb62-1428-4252-840f-9a8f0165c228 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:55.883935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b16b2f-3796-45cc-b1f9-ad2cb342d502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:55.884594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b16b2f-3796-45cc-b1f9-ad2cb342d502 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:55.884883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b16b2f-3796-45cc-b1f9-ad2cb342d502 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:55.885164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b16b2f-3796-45cc-b1f9-ad2cb342d502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:55.896264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b16b2f-3796-45cc-b1f9-ad2cb342d502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:55.898329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b16b2f-3796-45cc-b1f9-ad2cb342d502 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:55.909184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1101/2230] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:56.011472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91969c7fff0941e1858c53ddd2c60d57'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.075494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91969c7fff0941e1858c53ddd2c60d57'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.091148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91969c7fff0941e1858c53ddd2c60d57'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.092673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91969c7fff0941e1858c53ddd2c60d57'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.100941 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91969c7fff0941e1858c53ddd2c60d57'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.123371 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1130/2231] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:55 2022] DELETE /identity/v3/users/91969c7fff0941e1858c53ddd2c60d57 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:56.125286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449475c3-5bea-4ff9-ade7-bba6a66f434c None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:56.125642 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449475c3-5bea-4ff9-ade7-bba6a66f434c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:56.126045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449475c3-5bea-4ff9-ade7-bba6a66f434c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:56.144436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-449475c3-5bea-4ff9-ade7-bba6a66f434c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:56.146282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-449475c3-5bea-4ff9-ade7-bba6a66f434c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:56.172471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:56.219687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1102/2232] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:56.230172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:56.232127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:56.293446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:56.308441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0616e31-053c-4bf1-b46c-f188d154f212 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:56.312490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7c94-a814-4c52-ad20-02bbba338333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:56.313163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7c94-a814-4c52-ad20-02bbba338333 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:56.313449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7c94-a814-4c52-ad20-02bbba338333 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:56.313726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7c94-a814-4c52-ad20-02bbba338333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:56.329372 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a7c94-a814-4c52-ad20-02bbba338333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:56.331708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a7c94-a814-4c52-ad20-02bbba338333 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:56.344819 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1131/2233] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:56.364943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449475c3-5bea-4ff9-ade7-bba6a66f434c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:56.366554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-449475c3-5bea-4ff9-ade7-bba6a66f434c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:56.381232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449475c3-5bea-4ff9-ade7-bba6a66f434c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:56.401892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:56.401892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:56.401892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:56.401892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] PATH_INFO: `/v3/projects/47932c77de83419090a9f7206b14999f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:56.403889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47932c77de83419090a9f7206b14999f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:56.406815 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:56.554839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47932c77de83419090a9f7206b14999f', 'request_id': 'req-5e92c6be-a550-44b2-986f-2deb4a34f02d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.561187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47932c77de83419090a9f7206b14999f', 'request_id': 'req-5e92c6be-a550-44b2-986f-2deb4a34f02d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.618388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47932c77de83419090a9f7206b14999f', 'request_id': 'req-5e92c6be-a550-44b2-986f-2deb4a34f02d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.642688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] The token cache is being invalidate because project 47932c77de83419090a9f7206b14999f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:56.642999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.643802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:56.646443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1103/2234] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:56 2022] DELETE /identity/v3/projects/47932c77de83419090a9f7206b14999f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:56.794340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7c94-a814-4c52-ad20-02bbba338333 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:56.795832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fb1a7c94-a814-4c52-ad20-02bbba338333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:56.825224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7c94-a814-4c52-ad20-02bbba338333 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:56.923198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:56.924159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:56.924519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:56.924868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] PATH_INFO: `/v3/projects/b3892d27ebf947f3ad9522a6484e19e9` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:56.926201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3892d27ebf947f3ad9522a6484e19e9)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:56.928257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:57.019415 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3892d27ebf947f3ad9522a6484e19e9', 'request_id': 'req-73dabf39-95ef-4075-b3d8-c04ba3ab7685'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:57.086629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3892d27ebf947f3ad9522a6484e19e9', 'request_id': 'req-73dabf39-95ef-4075-b3d8-c04ba3ab7685'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:57.094159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3892d27ebf947f3ad9522a6484e19e9', 'request_id': 'req-73dabf39-95ef-4075-b3d8-c04ba3ab7685'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:57.105206 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] The token cache is being invalidate because project b3892d27ebf947f3ad9522a6484e19e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:57.105587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:57.106471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-73dabf39-95ef-4075-b3d8-c04ba3ab7685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:57.108496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1132/2235] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:56 2022] DELETE /identity/v3/projects/b3892d27ebf947f3ad9522a6484e19e9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:54:06.638846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:07.101956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:10.236715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:10.238185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:10.330324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c6be-a550-44b2-986f-2deb4a34f02d admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:10.392203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3238a52a3f6047e0acb0136ab39257e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:10.392868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:10.393158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:10.393441 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:10.395771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:10.406886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:10.408450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:10.418796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1104/2236] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:54:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:54:15.110578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268866-efa6-4b5f-b260-0eb2abe0e781 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:15.111049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268866-efa6-4b5f-b260-0eb2abe0e781 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:15.111144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268866-efa6-4b5f-b260-0eb2abe0e781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:15.175133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3e268866-efa6-4b5f-b260-0eb2abe0e781 None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:54:15.176261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3e268866-efa6-4b5f-b260-0eb2abe0e781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:15.238418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1133/2237] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:54:15.260660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:15.262138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:15.337565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:15.351109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d12517-7ba8-4dc7-a019-18be81ec19ff service placement] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:15.356140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b8de7-535d-48f6-a9ea-26323c11e282 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:15.356785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b8de7-535d-48f6-a9ea-26323c11e282 service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:15.357070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b8de7-535d-48f6-a9ea-26323c11e282 service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:15.357353 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b8de7-535d-48f6-a9ea-26323c11e282 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:15.365998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b8de7-535d-48f6-a9ea-26323c11e282 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:15.367595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b8de7-535d-48f6-a9ea-26323c11e282 service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:15.375767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1105/2238] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:54:25.235548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=40 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:25.372508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=8 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:39.579395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c99b8-027f-4c0e-a0d2-aed5b93fc7d3 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:39.579919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c99b8-027f-4c0e-a0d2-aed5b93fc7d3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:39.580020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c99b8-027f-4c0e-a0d2-aed5b93fc7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:39.598071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f33c99b8-027f-4c0e-a0d2-aed5b93fc7d3 None None] MFA Rules not processed for user `52599ae5d7a045e6b6156352322e5642`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:54:39.599861 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f33c99b8-027f-4c0e-a0d2-aed5b93fc7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:39.654181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1134/2239] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:54:49.647540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=25 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:02.415214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99be93-c9f4-4995-9cab-c24579f0658a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:55:02.415779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99be93-c9f4-4995-9cab-c24579f0658a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:55:02.415779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99be93-c9f4-4995-9cab-c24579f0658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:55:02.433571 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-0c99be93-c9f4-4995-9cab-c24579f0658a None None] MFA Rules not processed for user `60622199be2e44cd9c72f37c9d41e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:55:02.434923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-0c99be93-c9f4-4995-9cab-c24579f0658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:02.499277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1106/2240] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:55:05.825139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf4ecc-04b0-4084-88ab-e775cdb707d0 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:55:05.825576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf4ecc-04b0-4084-88ab-e775cdb707d0 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:55:05.825704 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf4ecc-04b0-4084-88ab-e775cdb707d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:55:05.843393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-5ccf4ecc-04b0-4084-88ab-e775cdb707d0 None None] MFA Rules not processed for user `b21bf3717c1045088c5f45a88b6c3b15`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:55:05.844641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5ccf4ecc-04b0-4084-88ab-e775cdb707d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:05.901990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1135/2241] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:55:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:55:12.489903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=25 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:15.893029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=25 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:28.356048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925103f5-fc06-496a-bbd2-f8e085c03dde None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:55:28.356546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925103f5-fc06-496a-bbd2-f8e085c03dde None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:55:28.358215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925103f5-fc06-496a-bbd2-f8e085c03dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:55:28.374365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-925103f5-fc06-496a-bbd2-f8e085c03dde None None] MFA Rules not processed for user `09664e6ce77d4f7690beea16a17d388f`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:55:28.375566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-925103f5-fc06-496a-bbd2-f8e085c03dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:28.431089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1107/2242] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:55:38.423755 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=25 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:48.973354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e7591-4358-4092-a67c-27b2d7c48d66 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:55:48.973876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e7591-4358-4092-a67c-27b2d7c48d66 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:55:48.974060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e7591-4358-4092-a67c-27b2d7c48d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:55:48.992348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-479e7591-4358-4092-a67c-27b2d7c48d66 None None] MFA Rules not processed for user `52599ae5d7a045e6b6156352322e5642`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:55:48.993551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-479e7591-4358-4092-a67c-27b2d7c48d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:49.000405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1136/2243] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:55:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:55:58.986073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:01.513287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925103f5-fc06-496a-bbd2-f8e085c03dde None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:01.514760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-925103f5-fc06-496a-bbd2-f8e085c03dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:01.583121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925103f5-fc06-496a-bbd2-f8e085c03dde None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:01.586928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a059d4a-0226-46d4-b097-173543bd4c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:01.587725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a059d4a-0226-46d4-b097-173543bd4c85 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:01.587886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a059d4a-0226-46d4-b097-173543bd4c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:01.588224 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a059d4a-0226-46d4-b097-173543bd4c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:01.590265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6a059d4a-0226-46d4-b097-173543bd4c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:01.662396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a059d4a-0226-46d4-b097-173543bd4c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:01.663841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a059d4a-0226-46d4-b097-173543bd4c85 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:01.674948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1108/2244] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:02.599695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e7591-4358-4092-a67c-27b2d7c48d66 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:02.601228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-479e7591-4358-4092-a67c-27b2d7c48d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:02.612898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e7591-4358-4092-a67c-27b2d7c48d66 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:02.617133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8721-7355-4222-9348-0bf93ef1960e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:02.617803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8721-7355-4222-9348-0bf93ef1960e service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:02.618222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8721-7355-4222-9348-0bf93ef1960e service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:02.618541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8721-7355-4222-9348-0bf93ef1960e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:02.620387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-744c8721-7355-4222-9348-0bf93ef1960e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:02.633778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c8721-7355-4222-9348-0bf93ef1960e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:02.635241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c8721-7355-4222-9348-0bf93ef1960e service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:02.646790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1137/2245] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:10.358904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a059d4a-0226-46d4-b097-173543bd4c85 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:10.367966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a059d4a-0226-46d4-b097-173543bd4c85 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:10.371589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abfd78-62ea-434f-9e8f-d471de9bf728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:10.372230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abfd78-62ea-434f-9e8f-d471de9bf728 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:10.372513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abfd78-62ea-434f-9e8f-d471de9bf728 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:10.372791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abfd78-62ea-434f-9e8f-d471de9bf728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:10.374614 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b2abfd78-62ea-434f-9e8f-d471de9bf728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:10.442665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abfd78-62ea-434f-9e8f-d471de9bf728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:10.444045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abfd78-62ea-434f-9e8f-d471de9bf728 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:10.454359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1109/2246] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:11.529750 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83b60f-9581-491a-8507-4950fec5f786 None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:11.530319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83b60f-9581-491a-8507-4950fec5f786 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:11.530409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83b60f-9581-491a-8507-4950fec5f786 None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:11.532248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1138/2247] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:56:11.539061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83150-58ec-48b1-85d1-905df0ef4977 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:11.542534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83150-58ec-48b1-85d1-905df0ef4977 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:11.542534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83150-58ec-48b1-85d1-905df0ef4977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:11.559155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-36d83150-58ec-48b1-85d1-905df0ef4977 None None] MFA Rules not processed for user `719afb6dcb154119beb18d2f1974fe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:11.560484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-36d83150-58ec-48b1-85d1-905df0ef4977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:11.568277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1110/2248] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:56:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:11.582813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83b60f-9581-491a-8507-4950fec5f786 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:11.600876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83b60f-9581-491a-8507-4950fec5f786 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:11.605933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93aeb4a-0fb3-4a47-9214-0ab5de775b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:11.607717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93aeb4a-0fb3-4a47-9214-0ab5de775b6f service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:11.608251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93aeb4a-0fb3-4a47-9214-0ab5de775b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:11.609316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93aeb4a-0fb3-4a47-9214-0ab5de775b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:11.631437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93aeb4a-0fb3-4a47-9214-0ab5de775b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:11.632924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93aeb4a-0fb3-4a47-9214-0ab5de775b6f service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:11.643405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1139/2249] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:11.765155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b73304-8903-491d-8c3d-579998860763 None None] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:11.765545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b73304-8903-491d-8c3d-579998860763 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:11.765918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b73304-8903-491d-8c3d-579998860763 None None] PATH_INFO: `/` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:11.767465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1111/2250] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:56:11.773373 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0869323-14d6-4469-b99a-7317e525427d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:11.773733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0869323-14d6-4469-b99a-7317e525427d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:11.774117 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0869323-14d6-4469-b99a-7317e525427d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:11.792573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d0869323-14d6-4469-b99a-7317e525427d None None] MFA Rules not processed for user `0f46cf6eb4a44a71bda92cb212a8009c`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:11.793876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d0869323-14d6-4469-b99a-7317e525427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:11.803907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1140/2251] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:56:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:11.818002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b73304-8903-491d-8c3d-579998860763 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:11.829647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b73304-8903-491d-8c3d-579998860763 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:11.833408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb71f9b-9ec2-48ba-93df-6cb93c465e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:11.834095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb71f9b-9ec2-48ba-93df-6cb93c465e96 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:11.834387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb71f9b-9ec2-48ba-93df-6cb93c465e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:11.834756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb71f9b-9ec2-48ba-93df-6cb93c465e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:11.846027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb71f9b-9ec2-48ba-93df-6cb93c465e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:11.847567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb71f9b-9ec2-48ba-93df-6cb93c465e96 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:11.858921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1112/2252] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:14.248142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0869323-14d6-4469-b99a-7317e525427d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:14.249825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d0869323-14d6-4469-b99a-7317e525427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:14.266942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0869323-14d6-4469-b99a-7317e525427d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:14.273107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:14.274343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:14.274636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:14.274968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] PATH_INFO: `/v3/users/60622199be2e44cd9c72f37c9d41e1b6` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:14.276754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60622199be2e44cd9c72f37c9d41e1b6)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:14.279150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:14.445519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60622199be2e44cd9c72f37c9d41e1b6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:14.515016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60622199be2e44cd9c72f37c9d41e1b6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:14.527940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60622199be2e44cd9c72f37c9d41e1b6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:14.528634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60622199be2e44cd9c72f37c9d41e1b6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:14.538030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b00857c5-6f68-4672-85a0-8a54a34b2699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60622199be2e44cd9c72f37c9d41e1b6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:14.544461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1141/2253] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:14 2022] DELETE /identity/v3/users/60622199be2e44cd9c72f37c9d41e1b6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:14.803682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb71f9b-9ec2-48ba-93df-6cb93c465e96 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:14.815818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb71f9b-9ec2-48ba-93df-6cb93c465e96 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:14.840997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:14.888467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:14.893885 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:14.894202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:14.894476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] PATH_INFO: `/v3/projects/813e7b66684f4431aa5724d04ab76fbd` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:14.895860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813e7b66684f4431aa5724d04ab76fbd)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:14.897773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:15.028472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813e7b66684f4431aa5724d04ab76fbd', 'request_id': 'req-3bd065e5-fa78-4445-8e4b-3a1896802eb4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:15.034538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813e7b66684f4431aa5724d04ab76fbd', 'request_id': 'req-3bd065e5-fa78-4445-8e4b-3a1896802eb4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:15.097570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813e7b66684f4431aa5724d04ab76fbd', 'request_id': 'req-3bd065e5-fa78-4445-8e4b-3a1896802eb4'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:15.115715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] The token cache is being invalidate because project 813e7b66684f4431aa5724d04ab76fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:56:15.115948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:15.116658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3bd065e5-fa78-4445-8e4b-3a1896802eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:15.118387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1113/2254] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:56:14 2022] DELETE /identity/v3/projects/813e7b66684f4431aa5724d04ab76fbd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:56:15.123529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd50a7-a035-44b6-a97e-7d610163fe4a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.124001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd50a7-a035-44b6-a97e-7d610163fe4a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.124279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd50a7-a035-44b6-a97e-7d610163fe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.146545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-62fd50a7-a035-44b6-a97e-7d610163fe4a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:15.147742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-62fd50a7-a035-44b6-a97e-7d610163fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:15.214607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1142/2255] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:56:15.222314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93224144-a569-4c57-9a20-1663ab32ee07 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.222802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93224144-a569-4c57-9a20-1663ab32ee07 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.223592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93224144-a569-4c57-9a20-1663ab32ee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.242388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-93224144-a569-4c57-9a20-1663ab32ee07 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:15.243592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-93224144-a569-4c57-9a20-1663ab32ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:15.251553 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1114/2256] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:15.255887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd50a7-a035-44b6-a97e-7d610163fe4a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:15.265560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd50a7-a035-44b6-a97e-7d610163fe4a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:15.270089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94216da5-296c-4a72-8795-5501780cad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:15.270743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94216da5-296c-4a72-8795-5501780cad33 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.271027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94216da5-296c-4a72-8795-5501780cad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.271303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94216da5-296c-4a72-8795-5501780cad33 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.272057 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94216da5-296c-4a72-8795-5501780cad33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:56:15.272361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94216da5-296c-4a72-8795-5501780cad33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:15.273961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94216da5-296c-4a72-8795-5501780cad33 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:15.285841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1143/2257] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:56:15.290135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93224144-a569-4c57-9a20-1663ab32ee07 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:15.299247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93224144-a569-4c57-9a20-1663ab32ee07 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:15.304391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecba688-0793-43d0-8e01-80cd45212f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:15.305032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecba688-0793-43d0-8e01-80cd45212f92 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.305314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecba688-0793-43d0-8e01-80cd45212f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.305591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecba688-0793-43d0-8e01-80cd45212f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.306319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecba688-0793-43d0-8e01-80cd45212f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:15.308204 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecba688-0793-43d0-8e01-80cd45212f92 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:15.414437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1115/2258] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:15 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:56:15.418514 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94216da5-296c-4a72-8795-5501780cad33 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:15.432036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94216da5-296c-4a72-8795-5501780cad33 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:15.458343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:15.490536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be313f-9e68-4f0b-802a-84184287aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:15.491242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be313f-9e68-4f0b-802a-84184287aa3a admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.491546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be313f-9e68-4f0b-802a-84184287aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.491806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be313f-9e68-4f0b-802a-84184287aa3a admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.492509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be313f-9e68-4f0b-802a-84184287aa3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:15.494458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be313f-9e68-4f0b-802a-84184287aa3a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:15.606657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1144/2259] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:15 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:15.610790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecba688-0793-43d0-8e01-80cd45212f92 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:15.620914 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecba688-0793-43d0-8e01-80cd45212f92 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:15.625664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31eb9f-0c6b-48b7-b34d-8a3e91e1acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:15.626422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31eb9f-0c6b-48b7-b34d-8a3e91e1acd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.626715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31eb9f-0c6b-48b7-b34d-8a3e91e1acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.627021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31eb9f-0c6b-48b7-b34d-8a3e91e1acd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.627763 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31eb9f-0c6b-48b7-b34d-8a3e91e1acd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:15.629458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31eb9f-0c6b-48b7-b34d-8a3e91e1acd1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:15.639979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1116/2260] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:15.643877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be313f-9e68-4f0b-802a-84184287aa3a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:15.654291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be313f-9e68-4f0b-802a-84184287aa3a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:15.658831 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd923d-e1ac-4d42-aa0f-b93a64dbe6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:15.659483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd923d-e1ac-4d42-aa0f-b93a64dbe6ff admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.659769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd923d-e1ac-4d42-aa0f-b93a64dbe6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.660050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd923d-e1ac-4d42-aa0f-b93a64dbe6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.661433 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd923d-e1ac-4d42-aa0f-b93a64dbe6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:15.663070 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd923d-e1ac-4d42-aa0f-b93a64dbe6ff admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:15.672733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1145/2261] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:15.676609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31eb9f-0c6b-48b7-b34d-8a3e91e1acd1 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:15.686532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31eb9f-0c6b-48b7-b34d-8a3e91e1acd1 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:15.691048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132febed-9b59-4d98-8223-0da06875d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:15.691955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132febed-9b59-4d98-8223-0da06875d434 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.692241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132febed-9b59-4d98-8223-0da06875d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.692522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132febed-9b59-4d98-8223-0da06875d434 admin admin] PATH_INFO: `/v3/projects/b06dc0b55a27400f9d86a47a12bac9d3/users/e10f357dd3f84c1f87bc28186a7cf912/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.706572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132febed-9b59-4d98-8223-0da06875d434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06dc0b55a27400f9d86a47a12bac9d3, user_id=e10f357dd3f84c1f87bc28186a7cf912, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:15.709760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132febed-9b59-4d98-8223-0da06875d434 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:15.778043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1117/2262] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:15 2022] PUT /identity/v3/projects/b06dc0b55a27400f9d86a47a12bac9d3/users/e10f357dd3f84c1f87bc28186a7cf912/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:15.789454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c01ac1-b36d-417c-a41b-5cb41afaaccf None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.789744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c01ac1-b36d-417c-a41b-5cb41afaaccf None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.790061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c01ac1-b36d-417c-a41b-5cb41afaaccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.817247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f6c01ac1-b36d-417c-a41b-5cb41afaaccf None None] MFA Rules not processed for user `e10f357dd3f84c1f87bc28186a7cf912`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:15.818550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f6c01ac1-b36d-417c-a41b-5cb41afaaccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:15.883806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1146/2263] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:15.888205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132febed-9b59-4d98-8223-0da06875d434 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:15.938324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:15.956390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132febed-9b59-4d98-8223-0da06875d434 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:15.961806 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023784-eb9d-46fe-b662-a5e910b913c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:15.962546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023784-eb9d-46fe-b662-a5e910b913c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:15.962840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023784-eb9d-46fe-b662-a5e910b913c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:15.963123 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023784-eb9d-46fe-b662-a5e910b913c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:15.963834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3023784-eb9d-46fe-b662-a5e910b913c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:15.966109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3023784-eb9d-46fe-b662-a5e910b913c7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:16.045627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1118/2264] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:15 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:16.047520 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c01ac1-b36d-417c-a41b-5cb41afaaccf None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:16.058865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c01ac1-b36d-417c-a41b-5cb41afaaccf None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:16.121203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03590c9f-6b07-4bd2-a753-2ac5f1eee272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:16.121863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03590c9f-6b07-4bd2-a753-2ac5f1eee272 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:16.122176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03590c9f-6b07-4bd2-a753-2ac5f1eee272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:16.122455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03590c9f-6b07-4bd2-a753-2ac5f1eee272 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:16.123162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03590c9f-6b07-4bd2-a753-2ac5f1eee272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:16.125100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03590c9f-6b07-4bd2-a753-2ac5f1eee272 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:16.223866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1147/2265] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:16 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:16.227778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023784-eb9d-46fe-b662-a5e910b913c7 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:16.238286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023784-eb9d-46fe-b662-a5e910b913c7 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:16.243409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d748494-2e40-4786-bad8-9d05fb0990e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:16.244066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748494-2e40-4786-bad8-9d05fb0990e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:16.244352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748494-2e40-4786-bad8-9d05fb0990e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:16.244634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748494-2e40-4786-bad8-9d05fb0990e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:16.245449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d748494-2e40-4786-bad8-9d05fb0990e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:16.247090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d748494-2e40-4786-bad8-9d05fb0990e0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:16.258194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1119/2266] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:16.262317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03590c9f-6b07-4bd2-a753-2ac5f1eee272 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:16.272296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03590c9f-6b07-4bd2-a753-2ac5f1eee272 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:16.277234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbfba4-3af6-4861-aa53-4d754d69da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:16.278153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbfba4-3af6-4861-aa53-4d754d69da98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:16.278441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbfba4-3af6-4861-aa53-4d754d69da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:16.278719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbfba4-3af6-4861-aa53-4d754d69da98 admin admin] PATH_INFO: `/v3/projects/87754bbd04da4912a516df298549f88f/users/deee59ce1f1641d784c4cd824e2481d4/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:16.293665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbfba4-3af6-4861-aa53-4d754d69da98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87754bbd04da4912a516df298549f88f, user_id=deee59ce1f1641d784c4cd824e2481d4, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:16.296405 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbfba4-3af6-4861-aa53-4d754d69da98 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:16.372914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:16.378094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1148/2267] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:16 2022] PUT /identity/v3/projects/87754bbd04da4912a516df298549f88f/users/deee59ce1f1641d784c4cd824e2481d4/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:16.382785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d748494-2e40-4786-bad8-9d05fb0990e0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:16.393191 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d748494-2e40-4786-bad8-9d05fb0990e0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:16.465521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42d744-ce9c-4141-9bd9-004897e066a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:16.466229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42d744-ce9c-4141-9bd9-004897e066a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:16.466515 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42d744-ce9c-4141-9bd9-004897e066a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:16.466818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42d744-ce9c-4141-9bd9-004897e066a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:16.467546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42d744-ce9c-4141-9bd9-004897e066a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:16.469145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42d744-ce9c-4141-9bd9-004897e066a6 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:16.479715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1120/2268] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:16.483950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbfba4-3af6-4861-aa53-4d754d69da98 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:16.494254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbfba4-3af6-4861-aa53-4d754d69da98 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:16.498968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ad03-3552-4b91-a0e1-e67455ab6d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:16.499852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ad03-3552-4b91-a0e1-e67455ab6d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:16.500138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ad03-3552-4b91-a0e1-e67455ab6d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:16.500422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ad03-3552-4b91-a0e1-e67455ab6d47 admin admin] PATH_INFO: `/v3/projects/87754bbd04da4912a516df298549f88f/users/deee59ce1f1641d784c4cd824e2481d4/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:16.502420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925ad03-3552-4b91-a0e1-e67455ab6d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87754bbd04da4912a516df298549f88f, user_id=deee59ce1f1641d784c4cd824e2481d4, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:16.505642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925ad03-3552-4b91-a0e1-e67455ab6d47 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:16.516246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1149/2269] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:16 2022] PUT /identity/v3/projects/87754bbd04da4912a516df298549f88f/users/deee59ce1f1641d784c4cd824e2481d4/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:16.526869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30e375-6435-4526-9e47-cbf22ce74701 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:16.527162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30e375-6435-4526-9e47-cbf22ce74701 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:16.527442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30e375-6435-4526-9e47-cbf22ce74701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:16.554177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9b30e375-6435-4526-9e47-cbf22ce74701 None None] MFA Rules not processed for user `deee59ce1f1641d784c4cd824e2481d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:16.555369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9b30e375-6435-4526-9e47-cbf22ce74701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:16.622672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1121/2270] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:16.633777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ad03-3552-4b91-a0e1-e67455ab6d47 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:16.635486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9925ad03-3552-4b91-a0e1-e67455ab6d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:16.692165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ad03-3552-4b91-a0e1-e67455ab6d47 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:16.695840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e9cac-aa44-44e8-afa6-3b566d98dbbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:16.696482 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e9cac-aa44-44e8-afa6-3b566d98dbbd service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:16.696772 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e9cac-aa44-44e8-afa6-3b566d98dbbd service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:16.697076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e9cac-aa44-44e8-afa6-3b566d98dbbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:16.705983 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e9cac-aa44-44e8-afa6-3b566d98dbbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:16.708048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e9cac-aa44-44e8-afa6-3b566d98dbbd service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:16.717635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1150/2271] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:16.817547 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30e375-6435-4526-9e47-cbf22ce74701 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:16.827639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30e375-6435-4526-9e47-cbf22ce74701 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:16.831638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659d638-8e5e-4de5-b8ef-4a4a059515c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:16.832991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659d638-8e5e-4de5-b8ef-4a4a059515c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:16.833277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659d638-8e5e-4de5-b8ef-4a4a059515c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:16.833555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659d638-8e5e-4de5-b8ef-4a4a059515c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:16.868355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:16.898305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659d638-8e5e-4de5-b8ef-4a4a059515c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:16.899951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659d638-8e5e-4de5-b8ef-4a4a059515c6 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:16.909973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1122/2272] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:19.916932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e9cac-aa44-44e8-afa6-3b566d98dbbd service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:19.983417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e9cac-aa44-44e8-afa6-3b566d98dbbd service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:19.987925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:19.988822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:19.989101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:19.989375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] PATH_INFO: `/v3/users/e10f357dd3f84c1f87bc28186a7cf912` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:19.990567 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10f357dd3f84c1f87bc28186a7cf912)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:19.992493 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:20.145603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10f357dd3f84c1f87bc28186a7cf912'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:20.200705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10f357dd3f84c1f87bc28186a7cf912'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:20.213048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10f357dd3f84c1f87bc28186a7cf912'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:20.213726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10f357dd3f84c1f87bc28186a7cf912'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:20.220862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10f357dd3f84c1f87bc28186a7cf912'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:20.227202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1151/2273] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:19 2022] DELETE /identity/v3/users/e10f357dd3f84c1f87bc28186a7cf912 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:20.231682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dea89-dd10-4918-8af3-52aecbc5f54b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:20.232143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dea89-dd10-4918-8af3-52aecbc5f54b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:20.232236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dea89-dd10-4918-8af3-52aecbc5f54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:20.248476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-765dea89-dd10-4918-8af3-52aecbc5f54b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:20.249649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-765dea89-dd10-4918-8af3-52aecbc5f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:20.307320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1123/2274] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:20.317451 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:20.318908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:20.329607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:20.376150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d4b03-85b7-4ae8-a42c-df4efad16a37 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:20.381089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01869-3e04-432a-b63c-d7675d55ada1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:20.381741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01869-3e04-432a-b63c-d7675d55ada1 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:20.382067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01869-3e04-432a-b63c-d7675d55ada1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:20.382352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01869-3e04-432a-b63c-d7675d55ada1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:20.391557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f01869-3e04-432a-b63c-d7675d55ada1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:20.392996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f01869-3e04-432a-b63c-d7675d55ada1 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:20.403205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1152/2275] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:20.876265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dea89-dd10-4918-8af3-52aecbc5f54b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:20.877680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-765dea89-dd10-4918-8af3-52aecbc5f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:20.891639 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dea89-dd10-4918-8af3-52aecbc5f54b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:20.901319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:20.901319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:20.901319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:20.901319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] PATH_INFO: `/v3/projects/b06dc0b55a27400f9d86a47a12bac9d3` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:20.901725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06dc0b55a27400f9d86a47a12bac9d3)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:20.903175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:20.998094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06dc0b55a27400f9d86a47a12bac9d3', 'request_id': 'req-903a577d-227c-4d87-a21b-4351e4c1f604'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.005371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06dc0b55a27400f9d86a47a12bac9d3', 'request_id': 'req-903a577d-227c-4d87-a21b-4351e4c1f604'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.063926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06dc0b55a27400f9d86a47a12bac9d3', 'request_id': 'req-903a577d-227c-4d87-a21b-4351e4c1f604'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.079606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] The token cache is being invalidate because project b06dc0b55a27400f9d86a47a12bac9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:56:21.080023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.081292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.083795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1124/2276] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:56:20 2022] DELETE /identity/v3/projects/b06dc0b55a27400f9d86a47a12bac9d3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:21.087661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01869-3e04-432a-b63c-d7675d55ada1 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:21.097815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01869-3e04-432a-b63c-d7675d55ada1 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:21.157101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:21.158040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:21.158332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:21.158615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] PATH_INFO: `/v3/users/deee59ce1f1641d784c4cd824e2481d4` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:21.161255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] RBAC: Authorizing `identity:delete_user(user_id=deee59ce1f1641d784c4cd824e2481d4)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:21.163287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:21.333158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deee59ce1f1641d784c4cd824e2481d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.410956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deee59ce1f1641d784c4cd824e2481d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.423449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deee59ce1f1641d784c4cd824e2481d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.424233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deee59ce1f1641d784c4cd824e2481d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.431882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6648b5cb-1026-4e82-ae3f-64712896639c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deee59ce1f1641d784c4cd824e2481d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:21.437876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1153/2277] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:21 2022] DELETE /identity/v3/users/deee59ce1f1641d784c4cd824e2481d4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:56:21.854592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:21.856069 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:21.871500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a577d-227c-4d87-a21b-4351e4c1f604 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:21.936484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:21.937381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:21.937673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:21.937986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] PATH_INFO: `/v3/projects/87754bbd04da4912a516df298549f88f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:21.939474 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87754bbd04da4912a516df298549f88f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:21.942162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:21.943636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:22.065259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87754bbd04da4912a516df298549f88f', 'request_id': 'req-7e263b8f-8383-4a3d-aef5-36a01b57b274'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:22.071623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87754bbd04da4912a516df298549f88f', 'request_id': 'req-7e263b8f-8383-4a3d-aef5-36a01b57b274'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:22.155157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87754bbd04da4912a516df298549f88f', 'request_id': 'req-7e263b8f-8383-4a3d-aef5-36a01b57b274'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:22.165649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] The token cache is being invalidate because project 87754bbd04da4912a516df298549f88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:56:22.166240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:22.166981 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7e263b8f-8383-4a3d-aef5-36a01b57b274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:22.169068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1125/2278] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:56:21 2022] DELETE /identity/v3/projects/87754bbd04da4912a516df298549f88f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:22.174081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccc70b-3efb-4022-aee9-17b917cff090 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.176853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccc70b-3efb-4022-aee9-17b917cff090 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.176853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccc70b-3efb-4022-aee9-17b917cff090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.192940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-e8ccc70b-3efb-4022-aee9-17b917cff090 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:22.194240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e8ccc70b-3efb-4022-aee9-17b917cff090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:22.220169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:22.252471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1154/2279] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:22.260493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d35d-4656-4de5-877a-f4778fee5b8d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.260784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d35d-4656-4de5-877a-f4778fee5b8d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.261066 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d35d-4656-4de5-877a-f4778fee5b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.279676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a6e6d35d-4656-4de5-877a-f4778fee5b8d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:22.280947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a6e6d35d-4656-4de5-877a-f4778fee5b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:22.288796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1126/2280] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:22.293198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccc70b-3efb-4022-aee9-17b917cff090 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:22.303377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccc70b-3efb-4022-aee9-17b917cff090 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:22.307902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b04fe-c813-4735-b2b0-7fc750aca0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:22.308551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b04fe-c813-4735-b2b0-7fc750aca0fb admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.308838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b04fe-c813-4735-b2b0-7fc750aca0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.309119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b04fe-c813-4735-b2b0-7fc750aca0fb admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.309846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b04fe-c813-4735-b2b0-7fc750aca0fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:56:22.310181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b04fe-c813-4735-b2b0-7fc750aca0fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:22.311797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b04fe-c813-4735-b2b0-7fc750aca0fb admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:22.323936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1155/2281] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:56:22.328151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6d35d-4656-4de5-877a-f4778fee5b8d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:22.338184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6d35d-4656-4de5-877a-f4778fee5b8d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:22.343202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0551408-4c2e-4376-92df-dbb74140b0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:22.348525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0551408-4c2e-4376-92df-dbb74140b0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.348525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0551408-4c2e-4376-92df-dbb74140b0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.348525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0551408-4c2e-4376-92df-dbb74140b0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.348525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0551408-4c2e-4376-92df-dbb74140b0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:22.348525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0551408-4c2e-4376-92df-dbb74140b0d7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:22.425175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1127/2282] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:22 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:22.429897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b04fe-c813-4735-b2b0-7fc750aca0fb admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:22.440078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b04fe-c813-4735-b2b0-7fc750aca0fb admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:22.498996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e67ea-d93e-4c4f-a926-8497a7b92946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:22.499666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e67ea-d93e-4c4f-a926-8497a7b92946 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.499955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e67ea-d93e-4c4f-a926-8497a7b92946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.500258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e67ea-d93e-4c4f-a926-8497a7b92946 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.500942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e67ea-d93e-4c4f-a926-8497a7b92946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:22.502967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e67ea-d93e-4c4f-a926-8497a7b92946 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:22.578307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1156/2283] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:22 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:22.583033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0551408-4c2e-4376-92df-dbb74140b0d7 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:22.594244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0551408-4c2e-4376-92df-dbb74140b0d7 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:22.598945 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca9841-cb77-4dc8-9ab4-a5c8ce4ad25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:22.599604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca9841-cb77-4dc8-9ab4-a5c8ce4ad25d admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.599891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca9841-cb77-4dc8-9ab4-a5c8ce4ad25d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.600172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca9841-cb77-4dc8-9ab4-a5c8ce4ad25d admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.600900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca9841-cb77-4dc8-9ab4-a5c8ce4ad25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:22.602543 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca9841-cb77-4dc8-9ab4-a5c8ce4ad25d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:22.612863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1128/2284] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:22.621562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e67ea-d93e-4c4f-a926-8497a7b92946 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:22.631952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e67ea-d93e-4c4f-a926-8497a7b92946 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:22.636564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249ff0a-6c6b-487a-b6b7-5ee987adff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:22.637214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249ff0a-6c6b-487a-b6b7-5ee987adff0d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.637510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249ff0a-6c6b-487a-b6b7-5ee987adff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.637792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249ff0a-6c6b-487a-b6b7-5ee987adff0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.638562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249ff0a-6c6b-487a-b6b7-5ee987adff0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:22.640201 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249ff0a-6c6b-487a-b6b7-5ee987adff0d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:22.650759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1157/2285] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:22.654448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca9841-cb77-4dc8-9ab4-a5c8ce4ad25d admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:22.664491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca9841-cb77-4dc8-9ab4-a5c8ce4ad25d admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:22.669342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e769f41-fb5f-4b82-b27b-12d7fb210f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:22.670238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e769f41-fb5f-4b82-b27b-12d7fb210f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.670523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e769f41-fb5f-4b82-b27b-12d7fb210f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.670800 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e769f41-fb5f-4b82-b27b-12d7fb210f27 admin admin] PATH_INFO: `/v3/projects/99285ff0a1ec465dae9f7d9510f138a0/users/fe9c64ddbd294cae9a466ec9a5db0504/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.686599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e769f41-fb5f-4b82-b27b-12d7fb210f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99285ff0a1ec465dae9f7d9510f138a0, user_id=fe9c64ddbd294cae9a466ec9a5db0504, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:22.689175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e769f41-fb5f-4b82-b27b-12d7fb210f27 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:22.790589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1129/2286] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:22 2022] PUT /identity/v3/projects/99285ff0a1ec465dae9f7d9510f138a0/users/fe9c64ddbd294cae9a466ec9a5db0504/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:56:22.802678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c989020-452b-40e0-966a-4f28d4e98104 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.802972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c989020-452b-40e0-966a-4f28d4e98104 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.803257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c989020-452b-40e0-966a-4f28d4e98104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.829167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7c989020-452b-40e0-966a-4f28d4e98104 None None] MFA Rules not processed for user `fe9c64ddbd294cae9a466ec9a5db0504`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:22.830404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7c989020-452b-40e0-966a-4f28d4e98104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:22.898001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1158/2287] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:22.902526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e769f41-fb5f-4b82-b27b-12d7fb210f27 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:22.964919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e769f41-fb5f-4b82-b27b-12d7fb210f27 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:22.969829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2738-b8f4-4424-a5bd-ff9b0b95e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:22.970522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2738-b8f4-4424-a5bd-ff9b0b95e90c admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:22.970815 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2738-b8f4-4424-a5bd-ff9b0b95e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:22.971098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2738-b8f4-4424-a5bd-ff9b0b95e90c admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:22.971854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba2738-b8f4-4424-a5bd-ff9b0b95e90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:22.973732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba2738-b8f4-4424-a5bd-ff9b0b95e90c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:23.048491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1130/2288] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:22 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:23.052969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c989020-452b-40e0-966a-4f28d4e98104 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:23.063879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c989020-452b-40e0-966a-4f28d4e98104 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:23.089850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:23.123422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d95f6-eb25-41c5-bb7c-17996db60574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:23.126271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d95f6-eb25-41c5-bb7c-17996db60574 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:23.126271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d95f6-eb25-41c5-bb7c-17996db60574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:23.126271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d95f6-eb25-41c5-bb7c-17996db60574 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:23.126271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d95f6-eb25-41c5-bb7c-17996db60574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:23.127612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d95f6-eb25-41c5-bb7c-17996db60574 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:23.228013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1159/2289] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:23 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:23.231956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2738-b8f4-4424-a5bd-ff9b0b95e90c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:23.243372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2738-b8f4-4424-a5bd-ff9b0b95e90c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:23.247866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2d593-e28d-4818-87a1-1e641aeca67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:23.248572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d593-e28d-4818-87a1-1e641aeca67b admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:23.248859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d593-e28d-4818-87a1-1e641aeca67b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:23.249142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d593-e28d-4818-87a1-1e641aeca67b admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:23.249878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2d593-e28d-4818-87a1-1e641aeca67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:23.251568 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2d593-e28d-4818-87a1-1e641aeca67b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:23.257489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:23.263173 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1131/2290] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:23.266994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d95f6-eb25-41c5-bb7c-17996db60574 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:23.276907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d95f6-eb25-41c5-bb7c-17996db60574 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:23.281731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab5069-30c3-4d73-aa6b-4ff9200b0b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:23.282473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab5069-30c3-4d73-aa6b-4ff9200b0b85 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:23.282757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab5069-30c3-4d73-aa6b-4ff9200b0b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:23.283033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab5069-30c3-4d73-aa6b-4ff9200b0b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:23.283762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab5069-30c3-4d73-aa6b-4ff9200b0b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:23.285911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab5069-30c3-4d73-aa6b-4ff9200b0b85 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:23.296070 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1160/2291] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:23.300135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2d593-e28d-4818-87a1-1e641aeca67b admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:23.311318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2d593-e28d-4818-87a1-1e641aeca67b admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:23.316115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6c3e2-2a4a-4959-a7de-befbbfe21179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:23.317037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6c3e2-2a4a-4959-a7de-befbbfe21179 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:23.317360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6c3e2-2a4a-4959-a7de-befbbfe21179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:23.317638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6c3e2-2a4a-4959-a7de-befbbfe21179 admin admin] PATH_INFO: `/v3/projects/bcdea4d3d7b64e0384916042e3619dc5/users/d5bfa3c3c9dc405daad7b8c1d104f7e1/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:23.332089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6c3e2-2a4a-4959-a7de-befbbfe21179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdea4d3d7b64e0384916042e3619dc5, user_id=d5bfa3c3c9dc405daad7b8c1d104f7e1, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:23.334988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6c3e2-2a4a-4959-a7de-befbbfe21179 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:23.413045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1132/2292] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:23 2022] PUT /identity/v3/projects/bcdea4d3d7b64e0384916042e3619dc5/users/d5bfa3c3c9dc405daad7b8c1d104f7e1/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:23.423304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26298837-82c2-4c99-88ba-03cc18fba35e None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:23.423607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26298837-82c2-4c99-88ba-03cc18fba35e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:23.426611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26298837-82c2-4c99-88ba-03cc18fba35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:23.451181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-26298837-82c2-4c99-88ba-03cc18fba35e None None] MFA Rules not processed for user `d5bfa3c3c9dc405daad7b8c1d104f7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:23.452399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-26298837-82c2-4c99-88ba-03cc18fba35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:23.516220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1161/2293] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:23.521330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6c3e2-2a4a-4959-a7de-befbbfe21179 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:23.581659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6c3e2-2a4a-4959-a7de-befbbfe21179 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:23.586927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c3a1c-28db-467b-9bd0-62c98986b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:23.587582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c3a1c-28db-467b-9bd0-62c98986b4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:23.587872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c3a1c-28db-467b-9bd0-62c98986b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:23.588266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c3a1c-28db-467b-9bd0-62c98986b4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:23.588958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c3a1c-28db-467b-9bd0-62c98986b4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:23.592124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c3a1c-28db-467b-9bd0-62c98986b4a8 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:23.674395 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1133/2294] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:23 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:23.678973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26298837-82c2-4c99-88ba-03cc18fba35e None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:23.689460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26298837-82c2-4c99-88ba-03cc18fba35e None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:23.745883 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c2a2a-c800-4eda-8797-dcb8ad39ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:23.746578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c2a2a-c800-4eda-8797-dcb8ad39ddc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:23.746868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c2a2a-c800-4eda-8797-dcb8ad39ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:23.747149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c2a2a-c800-4eda-8797-dcb8ad39ddc5 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:23.747834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c2a2a-c800-4eda-8797-dcb8ad39ddc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:23.749760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c2a2a-c800-4eda-8797-dcb8ad39ddc5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:23.835525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1162/2295] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:23 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:23.839893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c3a1c-28db-467b-9bd0-62c98986b4a8 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:23.850613 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c3a1c-28db-467b-9bd0-62c98986b4a8 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:23.855147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc410-214c-4204-9fe1-e581131ed0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:23.855805 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc410-214c-4204-9fe1-e581131ed0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:23.856094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc410-214c-4204-9fe1-e581131ed0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:23.856375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc410-214c-4204-9fe1-e581131ed0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:23.857137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc410-214c-4204-9fe1-e581131ed0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:23.858794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc410-214c-4204-9fe1-e581131ed0b2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:23.876058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1134/2296] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:23.880101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c2a2a-c800-4eda-8797-dcb8ad39ddc5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:23.890219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c2a2a-c800-4eda-8797-dcb8ad39ddc5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:23.895552 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ee4d8-b12d-4d69-a86b-b4f17f112ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:23.896543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ee4d8-b12d-4d69-a86b-b4f17f112ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:23.896708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ee4d8-b12d-4d69-a86b-b4f17f112ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:23.896989 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ee4d8-b12d-4d69-a86b-b4f17f112ddd admin admin] PATH_INFO: `/v3/projects/66d6c391de774e3abb201e8fa60c13da/users/21255f58a1c541ea8bc7e5de4ee7b8d6/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:23.912659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ee4d8-b12d-4d69-a86b-b4f17f112ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d6c391de774e3abb201e8fa60c13da, user_id=21255f58a1c541ea8bc7e5de4ee7b8d6, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:23.915422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ee4d8-b12d-4d69-a86b-b4f17f112ddd admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:23.996784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:24.001668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1163/2297] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:23 2022] PUT /identity/v3/projects/66d6c391de774e3abb201e8fa60c13da/users/21255f58a1c541ea8bc7e5de4ee7b8d6/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:24.007790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc410-214c-4204-9fe1-e581131ed0b2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:24.017849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc410-214c-4204-9fe1-e581131ed0b2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:24.074366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2609fc-6de3-4efd-9507-e6b60d06075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:24.075025 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2609fc-6de3-4efd-9507-e6b60d06075e admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:24.075311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2609fc-6de3-4efd-9507-e6b60d06075e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:24.075590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2609fc-6de3-4efd-9507-e6b60d06075e admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:24.076311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2609fc-6de3-4efd-9507-e6b60d06075e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:24.077912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2609fc-6de3-4efd-9507-e6b60d06075e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:24.088384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1135/2298] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:24.092715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ee4d8-b12d-4d69-a86b-b4f17f112ddd admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:24.103541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ee4d8-b12d-4d69-a86b-b4f17f112ddd admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:24.108119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cdfbb-1766-4b8a-8fc4-73e05eff3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:24.108994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cdfbb-1766-4b8a-8fc4-73e05eff3827 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:24.109280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cdfbb-1766-4b8a-8fc4-73e05eff3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:24.109559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cdfbb-1766-4b8a-8fc4-73e05eff3827 admin admin] PATH_INFO: `/v3/projects/66d6c391de774e3abb201e8fa60c13da/users/21255f58a1c541ea8bc7e5de4ee7b8d6/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:24.111558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cdfbb-1766-4b8a-8fc4-73e05eff3827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d6c391de774e3abb201e8fa60c13da, user_id=21255f58a1c541ea8bc7e5de4ee7b8d6, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:24.115024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cdfbb-1766-4b8a-8fc4-73e05eff3827 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:24.125878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1164/2299] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:24 2022] PUT /identity/v3/projects/66d6c391de774e3abb201e8fa60c13da/users/21255f58a1c541ea8bc7e5de4ee7b8d6/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:24.146268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276fc8f-0f65-48a4-b423-85830af7284f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:24.146565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276fc8f-0f65-48a4-b423-85830af7284f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:24.146852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276fc8f-0f65-48a4-b423-85830af7284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:24.173536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1276fc8f-0f65-48a4-b423-85830af7284f None None] MFA Rules not processed for user `21255f58a1c541ea8bc7e5de4ee7b8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:24.174767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1276fc8f-0f65-48a4-b423-85830af7284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:24.211457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:24.247312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1136/2300] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:24.258576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cdfbb-1766-4b8a-8fc4-73e05eff3827 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:24.260277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-150cdfbb-1766-4b8a-8fc4-73e05eff3827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:24.333494 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cdfbb-1766-4b8a-8fc4-73e05eff3827 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:24.337151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c96156-6551-42ae-a901-a62dd08c41d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:24.337789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96156-6551-42ae-a901-a62dd08c41d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:24.338136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96156-6551-42ae-a901-a62dd08c41d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:24.338467 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96156-6551-42ae-a901-a62dd08c41d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:24.347745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c96156-6551-42ae-a901-a62dd08c41d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:24.349223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c96156-6551-42ae-a901-a62dd08c41d3 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:24.358652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1165/2301] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:24.478063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276fc8f-0f65-48a4-b423-85830af7284f None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:24.479507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1276fc8f-0f65-48a4-b423-85830af7284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:24.491893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276fc8f-0f65-48a4-b423-85830af7284f None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:24.495470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da358f0-5f0f-40a6-bc11-ac3772220da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:24.496110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da358f0-5f0f-40a6-bc11-ac3772220da2 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:24.496434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da358f0-5f0f-40a6-bc11-ac3772220da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:24.496714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da358f0-5f0f-40a6-bc11-ac3772220da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:24.553520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da358f0-5f0f-40a6-bc11-ac3772220da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:24.555004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da358f0-5f0f-40a6-bc11-ac3772220da2 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:24.563922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1137/2302] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:25.719062 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c96156-6551-42ae-a901-a62dd08c41d3 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:25.720695 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-18c96156-6551-42ae-a901-a62dd08c41d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:25.803022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c96156-6551-42ae-a901-a62dd08c41d3 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:25.806639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e839d1074f24a5ba7a552472e167067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:25.807506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:25.807787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:25.808219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:25.811671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:25.872029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:25.873526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:25.882579 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1166/2303] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:26.271110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e396-e566-4919-975f-f4eb2056a66f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:26.271587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e396-e566-4919-975f-f4eb2056a66f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:26.271755 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e396-e566-4919-975f-f4eb2056a66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:26.292029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a100e396-e566-4919-975f-f4eb2056a66f None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:26.293216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a100e396-e566-4919-975f-f4eb2056a66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:26.354495 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1138/2304] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:56:26.531562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:26.532996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:26.563228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:26.606445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e29e4d-0042-4315-8f71-4f0d19aac861 service glance] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:26.611780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08d7d9-c827-4f25-9056-9a07344152d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:26.612599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08d7d9-c827-4f25-9056-9a07344152d0 service swift] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:26.612872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08d7d9-c827-4f25-9056-9a07344152d0 service swift] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:26.613150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08d7d9-c827-4f25-9056-9a07344152d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:26.623444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08d7d9-c827-4f25-9056-9a07344152d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:26.626239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08d7d9-c827-4f25-9056-9a07344152d0 service swift] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:26.635771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1167/2305] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:56:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:56:26.804275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e396-e566-4919-975f-f4eb2056a66f None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:26.805701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a100e396-e566-4919-975f-f4eb2056a66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:26.954663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e396-e566-4919-975f-f4eb2056a66f None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:26.960555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26e49f-31d2-4076-a5dd-78944fea300c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:26.961223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e49f-31d2-4076-a5dd-78944fea300c service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:26.961550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e49f-31d2-4076-a5dd-78944fea300c service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:26.961842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e49f-31d2-4076-a5dd-78944fea300c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:26.963920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-7f26e49f-31d2-4076-a5dd-78944fea300c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:26.983393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:27.053082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26e49f-31d2-4076-a5dd-78944fea300c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:27.054924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26e49f-31d2-4076-a5dd-78944fea300c service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:27.068190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1139/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:28.867067 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08d7d9-c827-4f25-9056-9a07344152d0 service swift] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:28.953981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08d7d9-c827-4f25-9056-9a07344152d0 service swift] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:28.965646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:28.968153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:28.968601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:28.969038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] PATH_INFO: `/v3/users/fe9c64ddbd294cae9a466ec9a5db0504` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:28.970525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9c64ddbd294cae9a466ec9a5db0504)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:28.973044 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:29.188157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9c64ddbd294cae9a466ec9a5db0504'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:29.264685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9c64ddbd294cae9a466ec9a5db0504'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:29.307790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9c64ddbd294cae9a466ec9a5db0504'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:29.308013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9c64ddbd294cae9a466ec9a5db0504'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:29.318076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9c64ddbd294cae9a466ec9a5db0504'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:29.325614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1168/2307] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:28 2022] DELETE /identity/v3/users/fe9c64ddbd294cae9a466ec9a5db0504 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:29.330578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4b68-38ca-4903-adc3-07b4c983eef3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:29.331628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4b68-38ca-4903-adc3-07b4c983eef3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:29.331628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4b68-38ca-4903-adc3-07b4c983eef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:29.352790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-326f4b68-38ca-4903-adc3-07b4c983eef3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:29.354295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-326f4b68-38ca-4903-adc3-07b4c983eef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:29.424954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1140/2308] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:29.435913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:29.442309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:29.486348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:29.511925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921c38-88ea-4cb8-bd3c-29e9c6878626 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:29.515924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdfd7d-97c7-4fee-9c11-d75671e720a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:29.516698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdfd7d-97c7-4fee-9c11-d75671e720a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:29.516989 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdfd7d-97c7-4fee-9c11-d75671e720a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:29.517268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdfd7d-97c7-4fee-9c11-d75671e720a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:29.535898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdfd7d-97c7-4fee-9c11-d75671e720a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:29.537375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdfd7d-97c7-4fee-9c11-d75671e720a3 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:29.551744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1169/2309] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:30.246600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f4b68-38ca-4903-adc3-07b4c983eef3 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:30.248320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-326f4b68-38ca-4903-adc3-07b4c983eef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:30.273083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f4b68-38ca-4903-adc3-07b4c983eef3 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:30.278346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:30.279234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:30.279521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:30.279803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] PATH_INFO: `/v3/projects/99285ff0a1ec465dae9f7d9510f138a0` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:30.281032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=99285ff0a1ec465dae9f7d9510f138a0)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:30.283236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:30.426925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99285ff0a1ec465dae9f7d9510f138a0', 'request_id': 'req-1d4e5358-204c-4962-9412-e01b6531c8be'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.441269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99285ff0a1ec465dae9f7d9510f138a0', 'request_id': 'req-1d4e5358-204c-4962-9412-e01b6531c8be'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.543194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99285ff0a1ec465dae9f7d9510f138a0', 'request_id': 'req-1d4e5358-204c-4962-9412-e01b6531c8be'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.555037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] The token cache is being invalidate because project 99285ff0a1ec465dae9f7d9510f138a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:56:30.555457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.556192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.561920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1141/2310] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:56:30 2022] DELETE /identity/v3/projects/99285ff0a1ec465dae9f7d9510f138a0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:30.565826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdfd7d-97c7-4fee-9c11-d75671e720a3 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:30.580574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdfd7d-97c7-4fee-9c11-d75671e720a3 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:30.654085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:30.654721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:30.655012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:30.655336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] PATH_INFO: `/v3/users/d5bfa3c3c9dc405daad7b8c1d104f7e1` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:30.656832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bfa3c3c9dc405daad7b8c1d104f7e1)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:30.658872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:30.849737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bfa3c3c9dc405daad7b8c1d104f7e1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.931657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bfa3c3c9dc405daad7b8c1d104f7e1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.945361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bfa3c3c9dc405daad7b8c1d104f7e1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.946136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bfa3c3c9dc405daad7b8c1d104f7e1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.956514 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bfa3c3c9dc405daad7b8c1d104f7e1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:30.964166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1170/2311] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:30 2022] DELETE /identity/v3/users/d5bfa3c3c9dc405daad7b8c1d104f7e1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:31.427839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:31.429492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:31.449833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e5358-204c-4962-9412-e01b6531c8be admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:31.497656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:31.529193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:31.530531 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:31.531022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:31.531520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] PATH_INFO: `/v3/projects/bcdea4d3d7b64e0384916042e3619dc5` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:31.533104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdea4d3d7b64e0384916042e3619dc5)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:31.536591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:31.687366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdea4d3d7b64e0384916042e3619dc5', 'request_id': 'req-9f24f76a-fc7a-4514-9d10-ebd5beff3701'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:31.694900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdea4d3d7b64e0384916042e3619dc5', 'request_id': 'req-9f24f76a-fc7a-4514-9d10-ebd5beff3701'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:31.762017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdea4d3d7b64e0384916042e3619dc5', 'request_id': 'req-9f24f76a-fc7a-4514-9d10-ebd5beff3701'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:31.775292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] The token cache is being invalidate because project bcdea4d3d7b64e0384916042e3619dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:56:31.775584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:31.776265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:31.778229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1142/2312] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:56:31 2022] DELETE /identity/v3/projects/bcdea4d3d7b64e0384916042e3619dc5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:31.782161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:31.784281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:31.801397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e368a7f-eb67-4569-a0bd-8d343a5ad4c6 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:31.867261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:31.875685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:31.876604 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:31.876894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:31.877176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] PATH_INFO: `/v3/users/21255f58a1c541ea8bc7e5de4ee7b8d6` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:31.878626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21255f58a1c541ea8bc7e5de4ee7b8d6)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:31.881382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:32.075263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21255f58a1c541ea8bc7e5de4ee7b8d6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:32.144005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21255f58a1c541ea8bc7e5de4ee7b8d6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:32.161245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21255f58a1c541ea8bc7e5de4ee7b8d6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:32.162006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21255f58a1c541ea8bc7e5de4ee7b8d6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:32.169865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0844d2fc-f063-40f7-a86a-1dc176bb7798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21255f58a1c541ea8bc7e5de4ee7b8d6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:32.182770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1171/2313] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:31 2022] DELETE /identity/v3/users/21255f58a1c541ea8bc7e5de4ee7b8d6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:32.658467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:32.661200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:32.698539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f76a-fc7a-4514-9d10-ebd5beff3701 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:32.778908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:32.779790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:32.780092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:32.780680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] PATH_INFO: `/v3/projects/66d6c391de774e3abb201e8fa60c13da` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:32.784283 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d6c391de774e3abb201e8fa60c13da)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:32.786357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:32.929979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d6c391de774e3abb201e8fa60c13da', 'request_id': 'req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:32.938638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d6c391de774e3abb201e8fa60c13da', 'request_id': 'req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:33.047268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d6c391de774e3abb201e8fa60c13da', 'request_id': 'req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:33.053460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:33.061981 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] The token cache is being invalidate because project 66d6c391de774e3abb201e8fa60c13da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:56:33.062651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:33.063356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-27bf00a2-1a25-4ca6-8ac5-f8f4af4b4c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:33.065095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1143/2314] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:56:32 2022] DELETE /identity/v3/projects/66d6c391de774e3abb201e8fa60c13da => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:33.071330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808faa-f8a8-4e48-a03e-247637fef28f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:33.071809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808faa-f8a8-4e48-a03e-247637fef28f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:33.071961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808faa-f8a8-4e48-a03e-247637fef28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:33.092521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-4f808faa-f8a8-4e48-a03e-247637fef28f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:33.093721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4f808faa-f8a8-4e48-a03e-247637fef28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:33.152373 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1172/2315] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:33.161350 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26746-8407-4869-800b-5fe7b37461db None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:33.161644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26746-8407-4869-800b-5fe7b37461db None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:33.161922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26746-8407-4869-800b-5fe7b37461db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:33.180171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ddb26746-8407-4869-800b-5fe7b37461db None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:33.181368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ddb26746-8407-4869-800b-5fe7b37461db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:33.189190 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1144/2316] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:33.193326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808faa-f8a8-4e48-a03e-247637fef28f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:33.203720 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808faa-f8a8-4e48-a03e-247637fef28f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:33.208341 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ad99a-4307-4f2d-9db6-016e3e5e328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:33.209001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ad99a-4307-4f2d-9db6-016e3e5e328d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:33.209284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ad99a-4307-4f2d-9db6-016e3e5e328d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:33.209560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ad99a-4307-4f2d-9db6-016e3e5e328d admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:33.210347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ad99a-4307-4f2d-9db6-016e3e5e328d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:56:33.210649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ad99a-4307-4f2d-9db6-016e3e5e328d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:33.212263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ad99a-4307-4f2d-9db6-016e3e5e328d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:33.225969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1173/2317] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:56:33.230397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb26746-8407-4869-800b-5fe7b37461db None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:33.240523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb26746-8407-4869-800b-5fe7b37461db None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:33.245238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0294c-f081-4d00-b044-ceb0f51ac640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:33.245897 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0294c-f081-4d00-b044-ceb0f51ac640 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:33.246218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0294c-f081-4d00-b044-ceb0f51ac640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:33.246498 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0294c-f081-4d00-b044-ceb0f51ac640 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:33.247235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0294c-f081-4d00-b044-ceb0f51ac640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:33.249153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0294c-f081-4d00-b044-ceb0f51ac640 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:33.548496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1145/2318] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:33 2022] POST /identity/v3/projects => generated 365 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:56:33.553696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ad99a-4307-4f2d-9db6-016e3e5e328d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:33.567985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ad99a-4307-4f2d-9db6-016e3e5e328d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:33.634297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f714317-f729-486c-baf5-b5eeeb33331a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:33.635188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f714317-f729-486c-baf5-b5eeeb33331a admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:33.641705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f714317-f729-486c-baf5-b5eeeb33331a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:33.642019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f714317-f729-486c-baf5-b5eeeb33331a admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:33.642747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f714317-f729-486c-baf5-b5eeeb33331a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:33.645237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f714317-f729-486c-baf5-b5eeeb33331a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:33.653091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:33.765402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1174/2319] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:33 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:33.769260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0294c-f081-4d00-b044-ceb0f51ac640 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:33.792944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0294c-f081-4d00-b044-ceb0f51ac640 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:33.811903 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593db2-ffe7-4f43-afe7-81d09f3637cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:33.813252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593db2-ffe7-4f43-afe7-81d09f3637cf admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:33.823335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593db2-ffe7-4f43-afe7-81d09f3637cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:33.823335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593db2-ffe7-4f43-afe7-81d09f3637cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:33.823335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39593db2-ffe7-4f43-afe7-81d09f3637cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:33.823335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39593db2-ffe7-4f43-afe7-81d09f3637cf admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:33.836088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1146/2320] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:33.838019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f714317-f729-486c-baf5-b5eeeb33331a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:33.850764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f714317-f729-486c-baf5-b5eeeb33331a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:33.855851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b72c9-6af2-42e1-a45f-0de14dcec3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:33.856773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b72c9-6af2-42e1-a45f-0de14dcec3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:33.857167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b72c9-6af2-42e1-a45f-0de14dcec3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:33.857592 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b72c9-6af2-42e1-a45f-0de14dcec3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:33.861068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b72c9-6af2-42e1-a45f-0de14dcec3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:33.861068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b72c9-6af2-42e1-a45f-0de14dcec3c7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:33.877502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1175/2321] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:33.878775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593db2-ffe7-4f43-afe7-81d09f3637cf admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:33.895314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593db2-ffe7-4f43-afe7-81d09f3637cf admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:33.908628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365bec6-d712-4086-b153-de63f39ad01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:33.908628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365bec6-d712-4086-b153-de63f39ad01e admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:33.908628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365bec6-d712-4086-b153-de63f39ad01e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:33.908628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365bec6-d712-4086-b153-de63f39ad01e admin admin] PATH_INFO: `/v3/projects/1e2d85e893624f7f912f368c25520403/users/80eb89664821449fbbc148f63439f46d/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:33.932883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365bec6-d712-4086-b153-de63f39ad01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2d85e893624f7f912f368c25520403, user_id=80eb89664821449fbbc148f63439f46d, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:33.937359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365bec6-d712-4086-b153-de63f39ad01e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:34.070258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1147/2322] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:33 2022] PUT /identity/v3/projects/1e2d85e893624f7f912f368c25520403/users/80eb89664821449fbbc148f63439f46d/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:34.081112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb968ad-7522-42fc-ab55-79e7c50bc1de None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:34.082603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb968ad-7522-42fc-ab55-79e7c50bc1de None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:34.083112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb968ad-7522-42fc-ab55-79e7c50bc1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:34.147425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7cb968ad-7522-42fc-ab55-79e7c50bc1de None None] MFA Rules not processed for user `80eb89664821449fbbc148f63439f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:34.150692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7cb968ad-7522-42fc-ab55-79e7c50bc1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:34.286228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1176/2323] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:34.291870 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365bec6-d712-4086-b153-de63f39ad01e admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:34.387577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365bec6-d712-4086-b153-de63f39ad01e admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:34.392953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0aea9-c44a-4e32-b43e-471182c3585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:34.393644 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0aea9-c44a-4e32-b43e-471182c3585d admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:34.393928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0aea9-c44a-4e32-b43e-471182c3585d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:34.394242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0aea9-c44a-4e32-b43e-471182c3585d admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:34.395485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0aea9-c44a-4e32-b43e-471182c3585d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:34.397410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0aea9-c44a-4e32-b43e-471182c3585d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:34.494907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1148/2324] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:34 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:34.498836 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb968ad-7522-42fc-ab55-79e7c50bc1de None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:34.511618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb968ad-7522-42fc-ab55-79e7c50bc1de None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:34.581484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4fca5-648f-4472-8f56-ee82531c4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:34.582971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4fca5-648f-4472-8f56-ee82531c4dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:34.585714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4fca5-648f-4472-8f56-ee82531c4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:34.586135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4fca5-648f-4472-8f56-ee82531c4dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:34.587119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4fca5-648f-4472-8f56-ee82531c4dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:34.590316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4fca5-648f-4472-8f56-ee82531c4dd7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:34.674777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0aea9-c44a-4e32-b43e-471182c3585d admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:34.676602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1177/2325] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:34 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:34.688102 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0aea9-c44a-4e32-b43e-471182c3585d admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:34.694538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ac641-9cba-41ac-8dd1-c173230406ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:34.695227 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac641-9cba-41ac-8dd1-c173230406ec admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:34.695515 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac641-9cba-41ac-8dd1-c173230406ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:34.695828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac641-9cba-41ac-8dd1-c173230406ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:34.696655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ac641-9cba-41ac-8dd1-c173230406ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:34.698880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ac641-9cba-41ac-8dd1-c173230406ec admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:34.713136 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1149/2326] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:34.717440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4fca5-648f-4472-8f56-ee82531c4dd7 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:34.728579 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4fca5-648f-4472-8f56-ee82531c4dd7 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:34.735178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0ef8-f795-4103-ae86-b5447d2c7df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:34.736109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0ef8-f795-4103-ae86-b5447d2c7df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:34.736392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0ef8-f795-4103-ae86-b5447d2c7df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:34.736666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0ef8-f795-4103-ae86-b5447d2c7df4 admin admin] PATH_INFO: `/v3/projects/662259ae6d5045db8186c7733d6c3963/users/aefbafff92864001bd1069795bce82f6/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:34.758112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e0ef8-f795-4103-ae86-b5447d2c7df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662259ae6d5045db8186c7733d6c3963, user_id=aefbafff92864001bd1069795bce82f6, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:34.760809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e0ef8-f795-4103-ae86-b5447d2c7df4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:34.843245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1178/2327] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:34 2022] PUT /identity/v3/projects/662259ae6d5045db8186c7733d6c3963/users/aefbafff92864001bd1069795bce82f6/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:34.847384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ac641-9cba-41ac-8dd1-c173230406ec admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:34.858726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ac641-9cba-41ac-8dd1-c173230406ec admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:34.934399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039274e8-8ff3-4c78-a0da-757436deb04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:34.935532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039274e8-8ff3-4c78-a0da-757436deb04b admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:34.935978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039274e8-8ff3-4c78-a0da-757436deb04b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:34.936465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039274e8-8ff3-4c78-a0da-757436deb04b admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:34.937367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039274e8-8ff3-4c78-a0da-757436deb04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:34.939161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039274e8-8ff3-4c78-a0da-757436deb04b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:34.952219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1150/2328] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:34.956098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0ef8-f795-4103-ae86-b5447d2c7df4 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:34.970275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0ef8-f795-4103-ae86-b5447d2c7df4 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:34.976101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119300-3535-4f29-a511-3a4d47daca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:34.977261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119300-3535-4f29-a511-3a4d47daca56 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:34.977712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119300-3535-4f29-a511-3a4d47daca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:34.978156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119300-3535-4f29-a511-3a4d47daca56 admin admin] PATH_INFO: `/v3/projects/662259ae6d5045db8186c7733d6c3963/users/aefbafff92864001bd1069795bce82f6/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:34.980146 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119300-3535-4f29-a511-3a4d47daca56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662259ae6d5045db8186c7733d6c3963, user_id=aefbafff92864001bd1069795bce82f6, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:34.983151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119300-3535-4f29-a511-3a4d47daca56 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:34.995509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1179/2329] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:34 2022] PUT /identity/v3/projects/662259ae6d5045db8186c7733d6c3963/users/aefbafff92864001bd1069795bce82f6/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:35.008218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b17a43-c861-4a39-9eff-c59116671abf None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:35.008511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b17a43-c861-4a39-9eff-c59116671abf None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:35.008796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b17a43-c861-4a39-9eff-c59116671abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:35.015110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:35.045742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-58b17a43-c861-4a39-9eff-c59116671abf None None] MFA Rules not processed for user `aefbafff92864001bd1069795bce82f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:35.048215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-58b17a43-c861-4a39-9eff-c59116671abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:35.131216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1151/2330] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:35.142160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119300-3535-4f29-a511-3a4d47daca56 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:35.145573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-68119300-3535-4f29-a511-3a4d47daca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:35.174766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:35.227828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119300-3535-4f29-a511-3a4d47daca56 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:35.227828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f66b05-8c01-4b65-a7d5-13d5f9c510a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:35.227828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f66b05-8c01-4b65-a7d5-13d5f9c510a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:35.227828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f66b05-8c01-4b65-a7d5-13d5f9c510a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:35.228197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f66b05-8c01-4b65-a7d5-13d5f9c510a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:35.243028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f66b05-8c01-4b65-a7d5-13d5f9c510a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:35.244749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f66b05-8c01-4b65-a7d5-13d5f9c510a7 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:35.259878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1180/2331] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:35.542993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b17a43-c861-4a39-9eff-c59116671abf None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:35.555127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b17a43-c861-4a39-9eff-c59116671abf None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:35.561611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0266-6ea6-4736-9372-cd13f8add6c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:35.562608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0266-6ea6-4736-9372-cd13f8add6c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:35.562971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0266-6ea6-4736-9372-cd13f8add6c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:35.563389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0266-6ea6-4736-9372-cd13f8add6c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:35.650476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa0266-6ea6-4736-9372-cd13f8add6c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:35.652052 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa0266-6ea6-4736-9372-cd13f8add6c7 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:35.663909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1152/2332] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:38.968368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f66b05-8c01-4b65-a7d5-13d5f9c510a7 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:38.969780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a8f66b05-8c01-4b65-a7d5-13d5f9c510a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:39.029150 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f66b05-8c01-4b65-a7d5-13d5f9c510a7 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:39.032865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5132dd-2b19-446c-a8f0-f8e3597bdcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:39.033511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5132dd-2b19-446c-a8f0-f8e3597bdcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:39.033799 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5132dd-2b19-446c-a8f0-f8e3597bdcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:39.034115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5132dd-2b19-446c-a8f0-f8e3597bdcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:39.036401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5d5132dd-2b19-446c-a8f0-f8e3597bdcb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:39.045802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5132dd-2b19-446c-a8f0-f8e3597bdcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:39.047262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5132dd-2b19-446c-a8f0-f8e3597bdcb9 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:39.056029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1181/2333] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:42.297435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0266-6ea6-4736-9372-cd13f8add6c7 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:42.361135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0266-6ea6-4736-9372-cd13f8add6c7 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:42.366411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:42.377535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:42.377535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:42.377535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] PATH_INFO: `/v3/users/80eb89664821449fbbc148f63439f46d` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:42.377535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80eb89664821449fbbc148f63439f46d)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:42.377535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:42.512137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:42.610232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80eb89664821449fbbc148f63439f46d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:42.692091 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80eb89664821449fbbc148f63439f46d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:42.692717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80eb89664821449fbbc148f63439f46d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:42.705162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80eb89664821449fbbc148f63439f46d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:42.705802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80eb89664821449fbbc148f63439f46d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:42.718923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1153/2334] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:42 2022] DELETE /identity/v3/users/80eb89664821449fbbc148f63439f46d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:42.724880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06500cc5-b643-4ede-aea9-2bb582f265e8 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:42.724880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06500cc5-b643-4ede-aea9-2bb582f265e8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:42.724880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06500cc5-b643-4ede-aea9-2bb582f265e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:42.742196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-06500cc5-b643-4ede-aea9-2bb582f265e8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:42.743425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-06500cc5-b643-4ede-aea9-2bb582f265e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:42.804160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1182/2335] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:56:42.813875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:42.815315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:42.873779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fda6c-5377-4bc6-a6d5-a5b4915a2a38 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:42.877371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8d5ea-380f-4207-bb03-531348bc3b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:42.878053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d5ea-380f-4207-bb03-531348bc3b06 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:42.878336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d5ea-380f-4207-bb03-531348bc3b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:42.879258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d5ea-380f-4207-bb03-531348bc3b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:42.888450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8d5ea-380f-4207-bb03-531348bc3b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:42.889881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8d5ea-380f-4207-bb03-531348bc3b06 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:42.904629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1154/2336] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:43.369666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06500cc5-b643-4ede-aea9-2bb582f265e8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:43.369666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-06500cc5-b643-4ede-aea9-2bb582f265e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:43.382681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06500cc5-b643-4ede-aea9-2bb582f265e8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:43.387628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:43.388606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:43.389000 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:43.389394 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] PATH_INFO: `/v3/projects/1e2d85e893624f7f912f368c25520403` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:43.390728 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2d85e893624f7f912f368c25520403)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:43.393378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:43.555524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2d85e893624f7f912f368c25520403', 'request_id': 'req-81b41845-14f8-45d7-ab11-2f48b0e060f8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:43.652452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2d85e893624f7f912f368c25520403', 'request_id': 'req-81b41845-14f8-45d7-ab11-2f48b0e060f8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:43.661667 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2d85e893624f7f912f368c25520403', 'request_id': 'req-81b41845-14f8-45d7-ab11-2f48b0e060f8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:43.663564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:43.674460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] The token cache is being invalidate because project 1e2d85e893624f7f912f368c25520403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:56:43.674755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:43.675444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:43.680028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1183/2337] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:56:43 2022] DELETE /identity/v3/projects/1e2d85e893624f7f912f368c25520403 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:43.681247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8d5ea-380f-4207-bb03-531348bc3b06 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:43.692869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8d5ea-380f-4207-bb03-531348bc3b06 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:43.758655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:43.759604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:43.760012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:43.760317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] PATH_INFO: `/v3/users/aefbafff92864001bd1069795bce82f6` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:43.761826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefbafff92864001bd1069795bce82f6)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:43.763795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:43.957065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefbafff92864001bd1069795bce82f6'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:43.959658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:44.027951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefbafff92864001bd1069795bce82f6'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:44.028685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefbafff92864001bd1069795bce82f6'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:44.042398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefbafff92864001bd1069795bce82f6'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:44.043091 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5f6d3f66-fe43-4fe7-99d1-9289fb3d73ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefbafff92864001bd1069795bce82f6'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:44.057577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1155/2338] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:43 2022] DELETE /identity/v3/users/aefbafff92864001bd1069795bce82f6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:44.489522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:44.491075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:44.504804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b41845-14f8-45d7-ab11-2f48b0e060f8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:44.576034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:44.576902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:44.577188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:44.577466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] PATH_INFO: `/v3/projects/662259ae6d5045db8186c7733d6c3963` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:44.578676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=662259ae6d5045db8186c7733d6c3963)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:44.580597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:44.687978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662259ae6d5045db8186c7733d6c3963', 'request_id': 'req-ebfdbc37-370d-4876-80d1-f6377f13a94a'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:44.761243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662259ae6d5045db8186c7733d6c3963', 'request_id': 'req-ebfdbc37-370d-4876-80d1-f6377f13a94a'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:44.769088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662259ae6d5045db8186c7733d6c3963', 'request_id': 'req-ebfdbc37-370d-4876-80d1-f6377f13a94a'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:44.785525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] The token cache is being invalidate because project 662259ae6d5045db8186c7733d6c3963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:56:44.786208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:44.790419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ebfdbc37-370d-4876-80d1-f6377f13a94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:44.792298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1184/2339] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:56:44 2022] DELETE /identity/v3/projects/662259ae6d5045db8186c7733d6c3963 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:56:44.797408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4014d52-35da-482d-bec1-66474f66521c None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:44.797916 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4014d52-35da-482d-bec1-66474f66521c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:44.798072 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4014d52-35da-482d-bec1-66474f66521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:44.820092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b4014d52-35da-482d-bec1-66474f66521c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:44.821393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b4014d52-35da-482d-bec1-66474f66521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:44.908115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1156/2340] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:44.915060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22aad3-0d75-4a29-91ef-1807d1d3a1e4 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:44.915351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22aad3-0d75-4a29-91ef-1807d1d3a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:44.915631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22aad3-0d75-4a29-91ef-1807d1d3a1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:44.919604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4014d52-35da-482d-bec1-66474f66521c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:44.920953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b4014d52-35da-482d-bec1-66474f66521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:44.937587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ea22aad3-0d75-4a29-91ef-1807d1d3a1e4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:44.939350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ea22aad3-0d75-4a29-91ef-1807d1d3a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:44.951918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1185/2341] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:44.953211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22aad3-0d75-4a29-91ef-1807d1d3a1e4 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:44.964042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22aad3-0d75-4a29-91ef-1807d1d3a1e4 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:44.969785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcf826-cf33-4892-84f5-d7802219ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:44.970576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcf826-cf33-4892-84f5-d7802219ddbf admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:44.970961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcf826-cf33-4892-84f5-d7802219ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:44.971338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcf826-cf33-4892-84f5-d7802219ddbf admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:44.973828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcf826-cf33-4892-84f5-d7802219ddbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:56:44.973828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcf826-cf33-4892-84f5-d7802219ddbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:44.975030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcf826-cf33-4892-84f5-d7802219ddbf admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:44.987964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1186/2342] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:56:44.993365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcf826-cf33-4892-84f5-d7802219ddbf admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:45.004492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcf826-cf33-4892-84f5-d7802219ddbf admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:45.007154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4014d52-35da-482d-bec1-66474f66521c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:45.012264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43fab8-8166-4a02-8bb4-d9b941ff3457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:45.012627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a402b9-0a4b-4137-af1c-2416699c0719 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3238a52a3f6047e0acb0136ab39257e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:45.013059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43fab8-8166-4a02-8bb4-d9b941ff3457 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:45.013416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43fab8-8166-4a02-8bb4-d9b941ff3457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:45.013524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a402b9-0a4b-4137-af1c-2416699c0719 service placement] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:45.013834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a402b9-0a4b-4137-af1c-2416699c0719 service placement] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:45.013924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43fab8-8166-4a02-8bb4-d9b941ff3457 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:45.014391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a402b9-0a4b-4137-af1c-2416699c0719 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:45.014655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43fab8-8166-4a02-8bb4-d9b941ff3457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:45.016844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43fab8-8166-4a02-8bb4-d9b941ff3457 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:45.017762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-93a402b9-0a4b-4137-af1c-2416699c0719 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:45.031447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a402b9-0a4b-4137-af1c-2416699c0719 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:45.033143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a402b9-0a4b-4137-af1c-2416699c0719 service placement] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:45.044938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1157/2343] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:56:45.134741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1187/2344] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:44 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:45.139169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a402b9-0a4b-4137-af1c-2416699c0719 service placement] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:45.150058 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a402b9-0a4b-4137-af1c-2416699c0719 service placement] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:45.202185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:45.208028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a02ed-3724-4b5b-bf4b-029410dc7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:45.208702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a02ed-3724-4b5b-bf4b-029410dc7673 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:45.208991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a02ed-3724-4b5b-bf4b-029410dc7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:45.209274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a02ed-3724-4b5b-bf4b-029410dc7673 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:45.209999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a02ed-3724-4b5b-bf4b-029410dc7673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:45.212029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a02ed-3724-4b5b-bf4b-029410dc7673 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:45.301519 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1158/2345] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:45 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:45.302711 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43fab8-8166-4a02-8bb4-d9b941ff3457 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:45.313846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43fab8-8166-4a02-8bb4-d9b941ff3457 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:45.319138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95186a0e-50ae-4f2e-97c5-76be4053cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:45.319918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95186a0e-50ae-4f2e-97c5-76be4053cf0e admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:45.320209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95186a0e-50ae-4f2e-97c5-76be4053cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:45.320489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95186a0e-50ae-4f2e-97c5-76be4053cf0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:45.321221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95186a0e-50ae-4f2e-97c5-76be4053cf0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:45.322867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95186a0e-50ae-4f2e-97c5-76be4053cf0e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:45.333529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1188/2346] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:45.338573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a02ed-3724-4b5b-bf4b-029410dc7673 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:45.348986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a02ed-3724-4b5b-bf4b-029410dc7673 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:45.353491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1f650-c9f7-4373-8f5b-0d4f295981ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:45.354177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1f650-c9f7-4373-8f5b-0d4f295981ed admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:45.354465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1f650-c9f7-4373-8f5b-0d4f295981ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:45.354743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1f650-c9f7-4373-8f5b-0d4f295981ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:45.355480 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1f650-c9f7-4373-8f5b-0d4f295981ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:45.357070 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1f650-c9f7-4373-8f5b-0d4f295981ed admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:45.367049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1159/2347] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:45.371052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95186a0e-50ae-4f2e-97c5-76be4053cf0e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:45.381823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95186a0e-50ae-4f2e-97c5-76be4053cf0e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:45.390089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d98572-113b-41fc-9ef9-7b94d25a8bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:45.390089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d98572-113b-41fc-9ef9-7b94d25a8bda admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:45.390089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d98572-113b-41fc-9ef9-7b94d25a8bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:45.390089 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d98572-113b-41fc-9ef9-7b94d25a8bda admin admin] PATH_INFO: `/v3/projects/c6570f02ae3241eca6b68aa17d5df401/users/4814a09c4c234e3db8e479dadb6f8f26/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:45.406061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d98572-113b-41fc-9ef9-7b94d25a8bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6570f02ae3241eca6b68aa17d5df401, user_id=4814a09c4c234e3db8e479dadb6f8f26, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:45.408774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d98572-113b-41fc-9ef9-7b94d25a8bda admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:45.498896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1189/2348] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:45 2022] PUT /identity/v3/projects/c6570f02ae3241eca6b68aa17d5df401/users/4814a09c4c234e3db8e479dadb6f8f26/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:45.510163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8d9e8-d448-4644-9a09-d40fc2d61833 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:45.510517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8d9e8-d448-4644-9a09-d40fc2d61833 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:45.510811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8d9e8-d448-4644-9a09-d40fc2d61833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:45.538266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-bda8d9e8-d448-4644-9a09-d40fc2d61833 None None] MFA Rules not processed for user `4814a09c4c234e3db8e479dadb6f8f26`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:45.539551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bda8d9e8-d448-4644-9a09-d40fc2d61833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:45.604999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1160/2349] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:45.622820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d98572-113b-41fc-9ef9-7b94d25a8bda admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:45.627166 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e5d98572-113b-41fc-9ef9-7b94d25a8bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:45.641881 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:45.699171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d98572-113b-41fc-9ef9-7b94d25a8bda admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:45.705175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552978e0-3d0a-466d-a85e-7d5767a24c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:45.706333 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552978e0-3d0a-466d-a85e-7d5767a24c46 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:45.706913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552978e0-3d0a-466d-a85e-7d5767a24c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:45.707416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552978e0-3d0a-466d-a85e-7d5767a24c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:45.718544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552978e0-3d0a-466d-a85e-7d5767a24c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:45.720009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552978e0-3d0a-466d-a85e-7d5767a24c46 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:45.728820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1190/2350] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:45.749745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8d9e8-d448-4644-9a09-d40fc2d61833 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:45.815507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8d9e8-d448-4644-9a09-d40fc2d61833 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:45.820121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:45.821001 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:45.821287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:45.821565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] PATH_INFO: `/v3/users/4814a09c4c234e3db8e479dadb6f8f26` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:45.822803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4814a09c4c234e3db8e479dadb6f8f26)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:45.825020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:46.021471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4814a09c4c234e3db8e479dadb6f8f26'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.080798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4814a09c4c234e3db8e479dadb6f8f26'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.081409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4814a09c4c234e3db8e479dadb6f8f26'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.092727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:46.098425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4814a09c4c234e3db8e479dadb6f8f26'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.098425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4814a09c4c234e3db8e479dadb6f8f26'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.108330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1161/2351] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:45 2022] DELETE /identity/v3/users/4814a09c4c234e3db8e479dadb6f8f26 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:46.112780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17d75d-a726-4cad-842f-678ab88dc937 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:46.113128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17d75d-a726-4cad-842f-678ab88dc937 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:46.113410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17d75d-a726-4cad-842f-678ab88dc937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:46.131100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3b17d75d-a726-4cad-842f-678ab88dc937 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:46.132281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3b17d75d-a726-4cad-842f-678ab88dc937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:46.191178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1191/2352] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:46.201406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:46.202816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:46.264356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ff894-42aa-4c46-a3e9-d2a29c6fd67c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:46.268081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d79a-2f78-41e9-9f45-ffdf4292200d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:46.268736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d79a-2f78-41e9-9f45-ffdf4292200d service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:46.269029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d79a-2f78-41e9-9f45-ffdf4292200d service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:46.269314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d79a-2f78-41e9-9f45-ffdf4292200d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:46.278557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7d79a-2f78-41e9-9f45-ffdf4292200d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:46.279920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7d79a-2f78-41e9-9f45-ffdf4292200d service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:46.289338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1162/2353] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:56:46.715988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17d75d-a726-4cad-842f-678ab88dc937 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:46.717577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3b17d75d-a726-4cad-842f-678ab88dc937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:46.732210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17d75d-a726-4cad-842f-678ab88dc937 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:46.737461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:46.739171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:46.740909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:46.740909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] PATH_INFO: `/v3/projects/c6570f02ae3241eca6b68aa17d5df401` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:46.741563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6570f02ae3241eca6b68aa17d5df401)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:46.742921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:46.862497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6570f02ae3241eca6b68aa17d5df401', 'request_id': 'req-defdcb04-21be-4f97-ab62-4d34ef616b86'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.938279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6570f02ae3241eca6b68aa17d5df401', 'request_id': 'req-defdcb04-21be-4f97-ab62-4d34ef616b86'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.945193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6570f02ae3241eca6b68aa17d5df401', 'request_id': 'req-defdcb04-21be-4f97-ab62-4d34ef616b86'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.955829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] The token cache is being invalidate because project c6570f02ae3241eca6b68aa17d5df401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:56:46.960228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.960228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-defdcb04-21be-4f97-ab62-4d34ef616b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:46.960228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1192/2354] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:56:46 2022] DELETE /identity/v3/projects/c6570f02ae3241eca6b68aa17d5df401 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:46.963915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1692dd-b6cb-4964-be91-a4695b19faa8 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:46.964466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1692dd-b6cb-4964-be91-a4695b19faa8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:46.964466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1692dd-b6cb-4964-be91-a4695b19faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:46.983120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-5f1692dd-b6cb-4964-be91-a4695b19faa8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:46.984470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-5f1692dd-b6cb-4964-be91-a4695b19faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:47.048127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1163/2355] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:47.055880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941cfb8-9196-4332-ae19-7fdb3771d130 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.056310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941cfb8-9196-4332-ae19-7fdb3771d130 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.056602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941cfb8-9196-4332-ae19-7fdb3771d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.075100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1941cfb8-9196-4332-ae19-7fdb3771d130 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:47.076390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1941cfb8-9196-4332-ae19-7fdb3771d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:47.084853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1193/2356] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:47.089078 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1692dd-b6cb-4964-be91-a4695b19faa8 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:47.099622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1692dd-b6cb-4964-be91-a4695b19faa8 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:47.104214 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b68a14-45e5-4f6a-bc98-13d775a43bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:47.104868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b68a14-45e5-4f6a-bc98-13d775a43bae admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.105159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b68a14-45e5-4f6a-bc98-13d775a43bae admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.105442 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b68a14-45e5-4f6a-bc98-13d775a43bae admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.106216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b68a14-45e5-4f6a-bc98-13d775a43bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:56:47.106535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b68a14-45e5-4f6a-bc98-13d775a43bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:47.108133 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b68a14-45e5-4f6a-bc98-13d775a43bae admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:47.120376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1164/2357] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:56:47.124638 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941cfb8-9196-4332-ae19-7fdb3771d130 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:47.134510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941cfb8-9196-4332-ae19-7fdb3771d130 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:47.139127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f2373-c7d7-4066-b174-3c3a8e80222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:47.139771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f2373-c7d7-4066-b174-3c3a8e80222f admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.142024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f2373-c7d7-4066-b174-3c3a8e80222f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.142024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f2373-c7d7-4066-b174-3c3a8e80222f admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.142024 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f2373-c7d7-4066-b174-3c3a8e80222f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:47.143014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f2373-c7d7-4066-b174-3c3a8e80222f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:47.225522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1194/2358] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:47 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:47.229856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b68a14-45e5-4f6a-bc98-13d775a43bae admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:47.240257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b68a14-45e5-4f6a-bc98-13d775a43bae admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:47.307668 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed131a-2b7d-4298-b0c6-361c90cd8208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:47.308377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed131a-2b7d-4298-b0c6-361c90cd8208 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.308661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed131a-2b7d-4298-b0c6-361c90cd8208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.308939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed131a-2b7d-4298-b0c6-361c90cd8208 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.309635 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed131a-2b7d-4298-b0c6-361c90cd8208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:47.311584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed131a-2b7d-4298-b0c6-361c90cd8208 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:47.384397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1165/2359] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:47 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:47.388406 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f2373-c7d7-4066-b174-3c3a8e80222f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:47.394303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:47.399559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f2373-c7d7-4066-b174-3c3a8e80222f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:47.404213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142f9a-a9b1-4487-b67d-5b9dcb1e40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:47.404870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142f9a-a9b1-4487-b67d-5b9dcb1e40ba admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.405156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142f9a-a9b1-4487-b67d-5b9dcb1e40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.405739 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142f9a-a9b1-4487-b67d-5b9dcb1e40ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.406503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a142f9a-a9b1-4487-b67d-5b9dcb1e40ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:47.408403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a142f9a-a9b1-4487-b67d-5b9dcb1e40ba admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:47.419848 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1195/2360] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:47.423849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed131a-2b7d-4298-b0c6-361c90cd8208 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:47.431982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:47.435771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed131a-2b7d-4298-b0c6-361c90cd8208 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:47.440396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd403e-5f1f-4c96-8cc2-c832a0a56632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:47.446127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd403e-5f1f-4c96-8cc2-c832a0a56632 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.446127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd403e-5f1f-4c96-8cc2-c832a0a56632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.446127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd403e-5f1f-4c96-8cc2-c832a0a56632 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.446127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd403e-5f1f-4c96-8cc2-c832a0a56632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:47.446127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd403e-5f1f-4c96-8cc2-c832a0a56632 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:47.454189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1166/2361] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:47.458400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142f9a-a9b1-4487-b67d-5b9dcb1e40ba admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:47.469017 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142f9a-a9b1-4487-b67d-5b9dcb1e40ba admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:47.474158 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d3fe1-d521-4617-937b-5009eceb8a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:47.475026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d3fe1-d521-4617-937b-5009eceb8a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.475308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d3fe1-d521-4617-937b-5009eceb8a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.475584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d3fe1-d521-4617-937b-5009eceb8a11 admin admin] PATH_INFO: `/v3/projects/e532d3705d3b467593b98029fc87c269/users/717678fbe8af4ef29034ddea2925a3f7/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.490443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d3fe1-d521-4617-937b-5009eceb8a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e532d3705d3b467593b98029fc87c269, user_id=717678fbe8af4ef29034ddea2925a3f7, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:47.493095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d3fe1-d521-4617-937b-5009eceb8a11 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:47.607445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1196/2362] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:47 2022] PUT /identity/v3/projects/e532d3705d3b467593b98029fc87c269/users/717678fbe8af4ef29034ddea2925a3f7/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:47.618622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ebb5-f4c5-4eca-af3e-c78eec2cbbf8 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.618918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ebb5-f4c5-4eca-af3e-c78eec2cbbf8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.619262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ebb5-f4c5-4eca-af3e-c78eec2cbbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.648605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-33a2ebb5-f4c5-4eca-af3e-c78eec2cbbf8 None None] MFA Rules not processed for user `717678fbe8af4ef29034ddea2925a3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:47.651746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-33a2ebb5-f4c5-4eca-af3e-c78eec2cbbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:47.716856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1167/2363] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:47.722164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d3fe1-d521-4617-937b-5009eceb8a11 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:47.808662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d3fe1-d521-4617-937b-5009eceb8a11 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:47.816777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4d10f-8c3b-401b-86e2-bb853668f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:47.817648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4d10f-8c3b-401b-86e2-bb853668f0ab admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.817933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4d10f-8c3b-401b-86e2-bb853668f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.818249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4d10f-8c3b-401b-86e2-bb853668f0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.818975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4d10f-8c3b-401b-86e2-bb853668f0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:47.821163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4d10f-8c3b-401b-86e2-bb853668f0ab admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:47.913097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1197/2364] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:47 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:47.917641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ebb5-f4c5-4eca-af3e-c78eec2cbbf8 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:47.928922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ebb5-f4c5-4eca-af3e-c78eec2cbbf8 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:47.988548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b854410-35ec-4569-83ae-9892aa456c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:47.989229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b854410-35ec-4569-83ae-9892aa456c07 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:47.989506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b854410-35ec-4569-83ae-9892aa456c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:47.989787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b854410-35ec-4569-83ae-9892aa456c07 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:47.990550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b854410-35ec-4569-83ae-9892aa456c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:47.992484 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b854410-35ec-4569-83ae-9892aa456c07 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:48.093819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1168/2365] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:47 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:56:48.098043 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4d10f-8c3b-401b-86e2-bb853668f0ab admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:48.109015 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4d10f-8c3b-401b-86e2-bb853668f0ab admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:48.114050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406cbab-4d9b-4f68-97ce-24c20ddfdb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:48.124922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406cbab-4d9b-4f68-97ce-24c20ddfdb7e admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:48.124922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406cbab-4d9b-4f68-97ce-24c20ddfdb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:48.124922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406cbab-4d9b-4f68-97ce-24c20ddfdb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:48.124922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406cbab-4d9b-4f68-97ce-24c20ddfdb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:48.124922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406cbab-4d9b-4f68-97ce-24c20ddfdb7e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:48.135131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1198/2366] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:48.135807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b854410-35ec-4569-83ae-9892aa456c07 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:48.147032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b854410-35ec-4569-83ae-9892aa456c07 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:48.152909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31488edc-010f-4431-b85c-2fa5585e9cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:48.153621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31488edc-010f-4431-b85c-2fa5585e9cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:48.154037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31488edc-010f-4431-b85c-2fa5585e9cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:48.154322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31488edc-010f-4431-b85c-2fa5585e9cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:48.155067 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31488edc-010f-4431-b85c-2fa5585e9cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:48.156685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31488edc-010f-4431-b85c-2fa5585e9cf1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:48.167268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1169/2367] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:48.171720 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406cbab-4d9b-4f68-97ce-24c20ddfdb7e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:48.183443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406cbab-4d9b-4f68-97ce-24c20ddfdb7e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:48.188410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ceb2f-be03-4a33-b1c6-00b3062db2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:48.189321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ceb2f-be03-4a33-b1c6-00b3062db2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:48.189603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ceb2f-be03-4a33-b1c6-00b3062db2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:48.189877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ceb2f-be03-4a33-b1c6-00b3062db2e0 admin admin] PATH_INFO: `/v3/projects/fa1f9b84630b41da952c8da4a166ad89/users/d05238805fb44dab8999599246c3e3cb/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:48.206156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ceb2f-be03-4a33-b1c6-00b3062db2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1f9b84630b41da952c8da4a166ad89, user_id=d05238805fb44dab8999599246c3e3cb, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:48.209486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ceb2f-be03-4a33-b1c6-00b3062db2e0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:48.317126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1199/2368] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:48 2022] PUT /identity/v3/projects/fa1f9b84630b41da952c8da4a166ad89/users/d05238805fb44dab8999599246c3e3cb/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:56:48.328508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786f1ca-3941-4817-a740-16bfcc6a1863 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:48.328817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786f1ca-3941-4817-a740-16bfcc6a1863 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:48.329128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786f1ca-3941-4817-a740-16bfcc6a1863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:48.357213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3786f1ca-3941-4817-a740-16bfcc6a1863 None None] MFA Rules not processed for user `d05238805fb44dab8999599246c3e3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:48.358474 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3786f1ca-3941-4817-a740-16bfcc6a1863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:48.417056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:48.434491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ceb2f-be03-4a33-b1c6-00b3062db2e0 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:48.436226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5c1ceb2f-be03-4a33-b1c6-00b3062db2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:48.446174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1170/2369] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:48.447152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786f1ca-3941-4817-a740-16bfcc6a1863 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:48.525575 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ceb2f-be03-4a33-b1c6-00b3062db2e0 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:48.528875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786f1ca-3941-4817-a740-16bfcc6a1863 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:48.531631 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b227c51-521a-4caa-9c90-6b2e4131af8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:48.532344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b227c51-521a-4caa-9c90-6b2e4131af8c service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:48.532665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b227c51-521a-4caa-9c90-6b2e4131af8c service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:48.532924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b227c51-521a-4caa-9c90-6b2e4131af8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:48.534178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f268-70d3-410a-8225-a125d5111d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:48.534956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f268-70d3-410a-8225-a125d5111d7a admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:48.535250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f268-70d3-410a-8225-a125d5111d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:48.535531 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f268-70d3-410a-8225-a125d5111d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:48.535756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4b227c51-521a-4caa-9c90-6b2e4131af8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:48.536224 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4f268-70d3-410a-8225-a125d5111d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:48.538241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4f268-70d3-410a-8225-a125d5111d7a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:48.550020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:48.596516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b227c51-521a-4caa-9c90-6b2e4131af8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:48.598280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b227c51-521a-4caa-9c90-6b2e4131af8c service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:48.608286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1200/2370] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:56:48.657814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1171/2371] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:56:48 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:56:48.661404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b227c51-521a-4caa-9c90-6b2e4131af8c service nova] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:48.673288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b227c51-521a-4caa-9c90-6b2e4131af8c service nova] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:48.742117 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f443d5-d4b5-4333-87b5-205a0133392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:48.745649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f443d5-d4b5-4333-87b5-205a0133392a admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:48.745649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f443d5-d4b5-4333-87b5-205a0133392a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:48.745649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f443d5-d4b5-4333-87b5-205a0133392a admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:48.745649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f443d5-d4b5-4333-87b5-205a0133392a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:48.746240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f443d5-d4b5-4333-87b5-205a0133392a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:48.837229 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1201/2372] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:56:48 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:56:48.838735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f268-70d3-410a-8225-a125d5111d7a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:48.849701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f268-70d3-410a-8225-a125d5111d7a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:48.854322 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b5fc-1b54-48f1-baa9-8e8f43b5ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:48.854983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b5fc-1b54-48f1-baa9-8e8f43b5ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:48.855524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b5fc-1b54-48f1-baa9-8e8f43b5ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:48.855868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b5fc-1b54-48f1-baa9-8e8f43b5ba7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:48.856557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077b5fc-1b54-48f1-baa9-8e8f43b5ba7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:48.858211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077b5fc-1b54-48f1-baa9-8e8f43b5ba7a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:48.870289 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1172/2373] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:48.929873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f443d5-d4b5-4333-87b5-205a0133392a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:48.942020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f443d5-d4b5-4333-87b5-205a0133392a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:48.954442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4a6d6-56ca-4dc8-9884-cd11be84c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:48.959282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4a6d6-56ca-4dc8-9884-cd11be84c24d admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:48.959282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4a6d6-56ca-4dc8-9884-cd11be84c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:48.959282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4a6d6-56ca-4dc8-9884-cd11be84c24d admin admin] PATH_INFO: `/v3/projects/90a0f2bec0194fb08c9ff94ee6c907f6/users/a5218a72ef79446d9e207e0e7c8fcfb1/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:48.976950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4a6d6-56ca-4dc8-9884-cd11be84c24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a0f2bec0194fb08c9ff94ee6c907f6, user_id=a5218a72ef79446d9e207e0e7c8fcfb1, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:48.979988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4a6d6-56ca-4dc8-9884-cd11be84c24d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:49.084867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1202/2374] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:48 2022] PUT /identity/v3/projects/90a0f2bec0194fb08c9ff94ee6c907f6/users/a5218a72ef79446d9e207e0e7c8fcfb1/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:49.095502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b5fc-1b54-48f1-baa9-8e8f43b5ba7a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:49.100533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b5fc-1b54-48f1-baa9-8e8f43b5ba7a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:49.140256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4a6d6-56ca-4dc8-9884-cd11be84c24d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:49.199340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617ec2-24f6-48d7-b791-ad1f92075079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:49.199340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617ec2-24f6-48d7-b791-ad1f92075079 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:49.199340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617ec2-24f6-48d7-b791-ad1f92075079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:49.199340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617ec2-24f6-48d7-b791-ad1f92075079 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:49.199720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b617ec2-24f6-48d7-b791-ad1f92075079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:49.199720 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b617ec2-24f6-48d7-b791-ad1f92075079 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:49.225420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1173/2375] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:56:49.225420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617ec2-24f6-48d7-b791-ad1f92075079 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:49.240944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617ec2-24f6-48d7-b791-ad1f92075079 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:49.246017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbee88-3019-4367-90e6-9e91e9343c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:49.247770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbee88-3019-4367-90e6-9e91e9343c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:49.247941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbee88-3019-4367-90e6-9e91e9343c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:49.248324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbee88-3019-4367-90e6-9e91e9343c1c admin admin] PATH_INFO: `/v3/projects/90a0f2bec0194fb08c9ff94ee6c907f6/users/a5218a72ef79446d9e207e0e7c8fcfb1/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:49.251246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbee88-3019-4367-90e6-9e91e9343c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a0f2bec0194fb08c9ff94ee6c907f6, user_id=a5218a72ef79446d9e207e0e7c8fcfb1, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:49.255461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbee88-3019-4367-90e6-9e91e9343c1c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:49.277390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1174/2376] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:56:49 2022] PUT /identity/v3/projects/90a0f2bec0194fb08c9ff94ee6c907f6/users/a5218a72ef79446d9e207e0e7c8fcfb1/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:49.279008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96dedd-aa4c-4183-b81e-94b162d42952 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:49.282180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96dedd-aa4c-4183-b81e-94b162d42952 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:49.282180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96dedd-aa4c-4183-b81e-94b162d42952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:49.286744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4a6d6-56ca-4dc8-9884-cd11be84c24d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:49.318202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:49.330491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-aa96dedd-aa4c-4183-b81e-94b162d42952 None None] MFA Rules not processed for user `a5218a72ef79446d9e207e0e7c8fcfb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:49.332942 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-aa96dedd-aa4c-4183-b81e-94b162d42952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:49.418431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:49.438957 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de27e-5de2-4009-9d47-2f81d5eca6b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:49.439784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de27e-5de2-4009-9d47-2f81d5eca6b4 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:49.440160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de27e-5de2-4009-9d47-2f81d5eca6b4 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:49.440326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de27e-5de2-4009-9d47-2f81d5eca6b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:49.445814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3d2de27e-5de2-4009-9d47-2f81d5eca6b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:49.459038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2de27e-5de2-4009-9d47-2f81d5eca6b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:49.461173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2de27e-5de2-4009-9d47-2f81d5eca6b4 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:49.469252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1175/2377] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:49.482449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96dedd-aa4c-4183-b81e-94b162d42952 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:49.483816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-aa96dedd-aa4c-4183-b81e-94b162d42952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:49.488488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1203/2378] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:56:49.559955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96dedd-aa4c-4183-b81e-94b162d42952 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:49.563993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba94b4-151d-4061-a60d-fe46631bc86f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:49.566217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba94b4-151d-4061-a60d-fe46631bc86f service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:49.566217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba94b4-151d-4061-a60d-fe46631bc86f service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:49.566217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba94b4-151d-4061-a60d-fe46631bc86f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:49.636120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba94b4-151d-4061-a60d-fe46631bc86f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:49.637890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba94b4-151d-4061-a60d-fe46631bc86f service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:49.648328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1176/2379] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:56:49.768302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885af65-4b13-45f5-87ee-aaec4ac8a7fd None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:49.768817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885af65-4b13-45f5-87ee-aaec4ac8a7fd None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:49.768987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885af65-4b13-45f5-87ee-aaec4ac8a7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:49.788382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-5885af65-4b13-45f5-87ee-aaec4ac8a7fd None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:49.790053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5885af65-4b13-45f5-87ee-aaec4ac8a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:49.855435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1204/2380] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:56:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:49.868271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba94b4-151d-4061-a60d-fe46631bc86f service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:49.869664 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1dba94b4-151d-4061-a60d-fe46631bc86f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:49.947940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba94b4-151d-4061-a60d-fe46631bc86f service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:49.953016 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1248-c790-4a3d-8270-c87c967585d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:49.953758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1248-c790-4a3d-8270-c87c967585d4 service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:49.963421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1248-c790-4a3d-8270-c87c967585d4 service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:49.963421 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1248-c790-4a3d-8270-c87c967585d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:49.963842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac1248-c790-4a3d-8270-c87c967585d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:49.965680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac1248-c790-4a3d-8270-c87c967585d4 service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:49.975397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1177/2381] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:56:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:56:51.742775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885af65-4b13-45f5-87ee-aaec4ac8a7fd None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:51.744565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5885af65-4b13-45f5-87ee-aaec4ac8a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:51.763356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885af65-4b13-45f5-87ee-aaec4ac8a7fd None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:51.767156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c55561-476a-4144-88ad-50e888648969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:51.767905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c55561-476a-4144-88ad-50e888648969 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:51.768269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c55561-476a-4144-88ad-50e888648969 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:51.768561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c55561-476a-4144-88ad-50e888648969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:51.843196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c55561-476a-4144-88ad-50e888648969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:51.844903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c55561-476a-4144-88ad-50e888648969 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:51.856999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1205/2382] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:53.473587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1248-c790-4a3d-8270-c87c967585d4 service swift] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:53.483562 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1248-c790-4a3d-8270-c87c967585d4 service swift] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:53.487768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f60811-ed5f-4f4a-983a-d73c3396d7dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:53.489319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f60811-ed5f-4f4a-983a-d73c3396d7dd service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:53.489597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f60811-ed5f-4f4a-983a-d73c3396d7dd service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:53.489873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f60811-ed5f-4f4a-983a-d73c3396d7dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:53.500499 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f60811-ed5f-4f4a-983a-d73c3396d7dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:53.502010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f60811-ed5f-4f4a-983a-d73c3396d7dd service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:53.512886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1178/2383] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:56.604270 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c55561-476a-4144-88ad-50e888648969 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:56.607701 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-74c55561-476a-4144-88ad-50e888648969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:56.667241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:56.672610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c55561-476a-4144-88ad-50e888648969 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:56.676593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60047668-c998-432f-864f-ff934180d9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:56.677237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60047668-c998-432f-864f-ff934180d9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:56.677521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60047668-c998-432f-864f-ff934180d9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:56.677794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60047668-c998-432f-864f-ff934180d9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:56.679938 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-60047668-c998-432f-864f-ff934180d9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:56.766610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60047668-c998-432f-864f-ff934180d9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:56.768834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60047668-c998-432f-864f-ff934180d9a9 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:56.796308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1206/2384] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:59.367947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f60811-ed5f-4f4a-983a-d73c3396d7dd service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:59.374582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:59.379491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f60811-ed5f-4f4a-983a-d73c3396d7dd service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:59.386970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:59.387860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:59.388132 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:59.389104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] PATH_INFO: `/v3/users/717678fbe8af4ef29034ddea2925a3f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:59.390379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=717678fbe8af4ef29034ddea2925a3f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:59.392608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:59.582313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717678fbe8af4ef29034ddea2925a3f7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:59.636290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717678fbe8af4ef29034ddea2925a3f7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:59.637260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717678fbe8af4ef29034ddea2925a3f7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:59.654086 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717678fbe8af4ef29034ddea2925a3f7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:59.654837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717678fbe8af4ef29034ddea2925a3f7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:56:59.669253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1179/2385] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:56:59 2022] DELETE /identity/v3/users/717678fbe8af4ef29034ddea2925a3f7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:56:59.674081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa833c-8ce4-4d76-9fe9-c90c081b2c1e None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:59.674590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa833c-8ce4-4d76-9fe9-c90c081b2c1e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:59.674681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa833c-8ce4-4d76-9fe9-c90c081b2c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:59.691931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d3fa833c-8ce4-4d76-9fe9-c90c081b2c1e None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:56:59.693149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d3fa833c-8ce4-4d76-9fe9-c90c081b2c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:59.762092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1207/2386] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:56:59.773358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:56:59.773358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:56:59.850170 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed31c25-ab27-45df-a955-05e6f05b5eb4 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:56:59.853890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885a789-3594-407c-ade7-8cdcfca4dfeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:56:59.854643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a789-3594-407c-ade7-8cdcfca4dfeb service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:56:59.854963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a789-3594-407c-ade7-8cdcfca4dfeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:56:59.855245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a789-3594-407c-ade7-8cdcfca4dfeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:56:59.870712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885a789-3594-407c-ade7-8cdcfca4dfeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:56:59.870712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885a789-3594-407c-ade7-8cdcfca4dfeb service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:56:59.882084 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1180/2387] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:00.431308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa833c-8ce4-4d76-9fe9-c90c081b2c1e None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:00.432840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d3fa833c-8ce4-4d76-9fe9-c90c081b2c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:00.447863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa833c-8ce4-4d76-9fe9-c90c081b2c1e None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:00.455072 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:00.456563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:00.457133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:00.457597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] PATH_INFO: `/v3/projects/e532d3705d3b467593b98029fc87c269` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:00.459129 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e532d3705d3b467593b98029fc87c269)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:00.461195 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:00.583993 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e532d3705d3b467593b98029fc87c269', 'request_id': 'req-049839f5-b49f-4375-9b61-5cf105d3431b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:00.682088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e532d3705d3b467593b98029fc87c269', 'request_id': 'req-049839f5-b49f-4375-9b61-5cf105d3431b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:00.693778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e532d3705d3b467593b98029fc87c269', 'request_id': 'req-049839f5-b49f-4375-9b61-5cf105d3431b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:00.706612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] The token cache is being invalidate because project e532d3705d3b467593b98029fc87c269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:00.706974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:00.707945 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:00.709698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1208/2388] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:00 2022] DELETE /identity/v3/projects/e532d3705d3b467593b98029fc87c269 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:00.726009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885a789-3594-407c-ade7-8cdcfca4dfeb service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:00.726009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885a789-3594-407c-ade7-8cdcfca4dfeb service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:00.786894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:00.787860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:00.788661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:00.788661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] PATH_INFO: `/v3/users/d05238805fb44dab8999599246c3e3cb` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:00.789970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05238805fb44dab8999599246c3e3cb)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:00.793449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:00.819397 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:01.009955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05238805fb44dab8999599246c3e3cb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.129702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05238805fb44dab8999599246c3e3cb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.132047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05238805fb44dab8999599246c3e3cb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.153958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05238805fb44dab8999599246c3e3cb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.154779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05238805fb44dab8999599246c3e3cb'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.169051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1181/2389] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:00 2022] DELETE /identity/v3/users/d05238805fb44dab8999599246c3e3cb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:01.278489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:01.280457 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:01.294514 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049839f5-b49f-4375-9b61-5cf105d3431b admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:01.310679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:01.350679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:01.351548 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:01.351834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:01.352109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] PATH_INFO: `/v3/users/09664e6ce77d4f7690beea16a17d388f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:01.353276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09664e6ce77d4f7690beea16a17d388f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:01.355311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:01.533527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09664e6ce77d4f7690beea16a17d388f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.599773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09664e6ce77d4f7690beea16a17d388f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.617678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09664e6ce77d4f7690beea16a17d388f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.618685 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09664e6ce77d4f7690beea16a17d388f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.626221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09664e6ce77d4f7690beea16a17d388f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.632762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1209/2390] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:01 2022] DELETE /identity/v3/users/09664e6ce77d4f7690beea16a17d388f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:01.712275 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:01.714413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:01.730654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dbf07-5b06-4185-bc19-36810e7b01da admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:01.801327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:01.802242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:01.802531 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:01.802813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] PATH_INFO: `/v3/projects/fa1f9b84630b41da952c8da4a166ad89` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:01.804013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1f9b84630b41da952c8da4a166ad89)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:01.806068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:01.883374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:01.884799 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:01.905577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00355-6c74-46e8-b5d9-960f5201b0f6 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:01.911324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:01.912524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:01.913025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:01.913751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] PATH_INFO: `/v3/projects/47fae0e126944392aac63d657646d5e0` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:01.915283 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47fae0e126944392aac63d657646d5e0)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:01.917699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:01.923668 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1f9b84630b41da952c8da4a166ad89', 'request_id': 'req-d3719f43-968b-4138-90b5-13c14d248cba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.932339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1f9b84630b41da952c8da4a166ad89', 'request_id': 'req-d3719f43-968b-4138-90b5-13c14d248cba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:01.990109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1f9b84630b41da952c8da4a166ad89', 'request_id': 'req-d3719f43-968b-4138-90b5-13c14d248cba'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.001963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] The token cache is being invalidate because project fa1f9b84630b41da952c8da4a166ad89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:02.002291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.002950 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.005090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1182/2391] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:01 2022] DELETE /identity/v3/projects/fa1f9b84630b41da952c8da4a166ad89 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:02.009244 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:02.010612 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:02.041792 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47fae0e126944392aac63d657646d5e0', 'request_id': 'req-fe5b98af-c820-4791-b6b0-da1c1a59f669'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.061537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:02.099842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719f43-968b-4138-90b5-13c14d248cba admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:02.129749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47fae0e126944392aac63d657646d5e0', 'request_id': 'req-fe5b98af-c820-4791-b6b0-da1c1a59f669'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.137133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47fae0e126944392aac63d657646d5e0', 'request_id': 'req-fe5b98af-c820-4791-b6b0-da1c1a59f669'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.148679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] The token cache is being invalidate because project 47fae0e126944392aac63d657646d5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:02.148975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.149754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-fe5b98af-c820-4791-b6b0-da1c1a59f669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.151645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1210/2392] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:01 2022] DELETE /identity/v3/projects/47fae0e126944392aac63d657646d5e0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:02.157101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca606e29-423c-47f5-8ee0-916cdd0ba37a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.157803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca606e29-423c-47f5-8ee0-916cdd0ba37a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.158281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca606e29-423c-47f5-8ee0-916cdd0ba37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.162927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:02.163806 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.164093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.164370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] PATH_INFO: `/v3/users/a5218a72ef79446d9e207e0e7c8fcfb1` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.165663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5218a72ef79446d9e207e0e7c8fcfb1)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:02.167701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:02.181110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ca606e29-423c-47f5-8ee0-916cdd0ba37a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:02.182416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ca606e29-423c-47f5-8ee0-916cdd0ba37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:02.193761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1211/2393] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:02.202386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cbcb5-f710-4b4f-9299-ca2f5cfbf2af None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.202688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cbcb5-f710-4b4f-9299-ca2f5cfbf2af None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.202973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cbcb5-f710-4b4f-9299-ca2f5cfbf2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.221871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-2d5cbcb5-f710-4b4f-9299-ca2f5cfbf2af None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:02.223134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2d5cbcb5-f710-4b4f-9299-ca2f5cfbf2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:02.231420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1212/2394] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:02.235252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cbcb5-f710-4b4f-9299-ca2f5cfbf2af None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:02.252485 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cbcb5-f710-4b4f-9299-ca2f5cfbf2af None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:02.254084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b254c-65fd-4393-b37a-38b19ab472c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:02.254776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b254c-65fd-4393-b37a-38b19ab472c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.255061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b254c-65fd-4393-b37a-38b19ab472c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.255525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b254c-65fd-4393-b37a-38b19ab472c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.256254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b254c-65fd-4393-b37a-38b19ab472c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:02.256565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b254c-65fd-4393-b37a-38b19ab472c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:02.258220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b254c-65fd-4393-b37a-38b19ab472c2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:02.276409 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1213/2395] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:57:02.277277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b254c-65fd-4393-b37a-38b19ab472c2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:02.288245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b254c-65fd-4393-b37a-38b19ab472c2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:02.294868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e84a55-352c-4166-9962-981489de906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:02.295531 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e84a55-352c-4166-9962-981489de906e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.296539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e84a55-352c-4166-9962-981489de906e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.296539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e84a55-352c-4166-9962-981489de906e admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.296826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e84a55-352c-4166-9962-981489de906e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:02.298786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e84a55-352c-4166-9962-981489de906e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:02.333824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5218a72ef79446d9e207e0e7c8fcfb1'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.407126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5218a72ef79446d9e207e0e7c8fcfb1'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.407961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5218a72ef79446d9e207e0e7c8fcfb1'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.422898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5218a72ef79446d9e207e0e7c8fcfb1'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.424725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5218a72ef79446d9e207e0e7c8fcfb1'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:02.425078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1214/2396] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:02 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:02.427609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:02.436699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e84a55-352c-4166-9962-981489de906e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:02.438699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-42e84a55-352c-4166-9962-981489de906e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:02.440029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1183/2397] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:02 2022] DELETE /identity/v3/users/a5218a72ef79446d9e207e0e7c8fcfb1 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:02.504216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e84a55-352c-4166-9962-981489de906e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:02.560939 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b07139-0483-463a-9451-18e249a36034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:02.561608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b07139-0483-463a-9451-18e249a36034 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.561893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b07139-0483-463a-9451-18e249a36034 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.562207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b07139-0483-463a-9451-18e249a36034 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.562887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b07139-0483-463a-9451-18e249a36034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:02.565927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b07139-0483-463a-9451-18e249a36034 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:02.681422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1215/2398] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:02 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:02.682332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:02.703906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378b0ad-16d4-44e1-908b-b9be8c7644ef admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:02.713931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491459-eb98-4484-80bc-233c31e579f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:02.714656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491459-eb98-4484-80bc-233c31e579f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.715000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491459-eb98-4484-80bc-233c31e579f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.715558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491459-eb98-4484-80bc-233c31e579f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.716422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb491459-eb98-4484-80bc-233c31e579f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:02.718928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb491459-eb98-4484-80bc-233c31e579f7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:02.729973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1184/2399] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:57:02.734327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b07139-0483-463a-9451-18e249a36034 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:02.745111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b07139-0483-463a-9451-18e249a36034 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:02.749883 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957031fd-9961-4850-9c1f-47df2f63748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:02.750630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957031fd-9961-4850-9c1f-47df2f63748f admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.750918 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957031fd-9961-4850-9c1f-47df2f63748f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.751198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957031fd-9961-4850-9c1f-47df2f63748f admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.751932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957031fd-9961-4850-9c1f-47df2f63748f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:02.757364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957031fd-9961-4850-9c1f-47df2f63748f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:02.773294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1216/2400] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:02.774766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491459-eb98-4484-80bc-233c31e579f7 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:02.786470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491459-eb98-4484-80bc-233c31e579f7 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:02.797130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe6479-164a-44c7-9f02-c4f06e97daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:02.798112 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe6479-164a-44c7-9f02-c4f06e97daad admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.798399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe6479-164a-44c7-9f02-c4f06e97daad admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.798678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe6479-164a-44c7-9f02-c4f06e97daad admin admin] PATH_INFO: `/v3/projects/a2e66781eb794b01be86b49358215559/users/abda9898d977453ab8e11a5b7625394e/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.824462 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe6479-164a-44c7-9f02-c4f06e97daad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e66781eb794b01be86b49358215559, user_id=abda9898d977453ab8e11a5b7625394e, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:02.824462 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe6479-164a-44c7-9f02-c4f06e97daad admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:02.899615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957031fd-9961-4850-9c1f-47df2f63748f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:02.901367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-957031fd-9961-4850-9c1f-47df2f63748f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:02.913357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1185/2401] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:02 2022] PUT /identity/v3/projects/a2e66781eb794b01be86b49358215559/users/abda9898d977453ab8e11a5b7625394e/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:02.923249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957031fd-9961-4850-9c1f-47df2f63748f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:02.923705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfe0fd-6b3e-4c52-82bc-38c5d596637c None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.924055 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfe0fd-6b3e-4c52-82bc-38c5d596637c None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.924267 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfe0fd-6b3e-4c52-82bc-38c5d596637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.952436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-25cfe0fd-6b3e-4c52-82bc-38c5d596637c None None] MFA Rules not processed for user `abda9898d977453ab8e11a5b7625394e`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:02.955010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-25cfe0fd-6b3e-4c52-82bc-38c5d596637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:02.986822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:02.987303 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:02.987659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:02.988572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] PATH_INFO: `/v3/projects/90a0f2bec0194fb08c9ff94ee6c907f6` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:02.990054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a0f2bec0194fb08c9ff94ee6c907f6)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:02.992198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:03.026968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1186/2402] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:03.038718 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfe0fd-6b3e-4c52-82bc-38c5d596637c None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:03.040232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-25cfe0fd-6b3e-4c52-82bc-38c5d596637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:03.088259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a0f2bec0194fb08c9ff94ee6c907f6', 'request_id': 'req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:03.099851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:03.122769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfe0fd-6b3e-4c52-82bc-38c5d596637c None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:03.155371 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a0f2bec0194fb08c9ff94ee6c907f6', 'request_id': 'req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:03.162698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a0f2bec0194fb08c9ff94ee6c907f6', 'request_id': 'req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:03.173446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] The token cache is being invalidate because project 90a0f2bec0194fb08c9ff94ee6c907f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:03.173765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:03.174516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:03.176729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1217/2403] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:02 2022] DELETE /identity/v3/projects/90a0f2bec0194fb08c9ff94ee6c907f6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:03.177796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:03.181193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:03.190476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92df2a-c922-4baf-bd6f-2b4522d8ef7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:03.191401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92df2a-c922-4baf-bd6f-2b4522d8ef7b service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.191908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92df2a-c922-4baf-bd6f-2b4522d8ef7b service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.192196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92df2a-c922-4baf-bd6f-2b4522d8ef7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.194908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9c92df2a-c922-4baf-bd6f-2b4522d8ef7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:03.256633 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92df2a-c922-4baf-bd6f-2b4522d8ef7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:03.258476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c8d8b-bd59-4e70-8cd0-a1f8d8eefd4f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:03.268391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92df2a-c922-4baf-bd6f-2b4522d8ef7b service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:03.268587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79db68-e860-43fb-92da-a8cb5e4ebc17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:03.268587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79db68-e860-43fb-92da-a8cb5e4ebc17 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.268587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79db68-e860-43fb-92da-a8cb5e4ebc17 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.268587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79db68-e860-43fb-92da-a8cb5e4ebc17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.268910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3b79db68-e860-43fb-92da-a8cb5e4ebc17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:03.274071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1187/2404] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:57:03.276253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a7137-5417-4e6c-8a20-479f6ff5f8bd None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.276752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a7137-5417-4e6c-8a20-479f6ff5f8bd None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.277200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a7137-5417-4e6c-8a20-479f6ff5f8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.281343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79db68-e860-43fb-92da-a8cb5e4ebc17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:03.282996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79db68-e860-43fb-92da-a8cb5e4ebc17 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:03.299554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9a7a7137-5417-4e6c-8a20-479f6ff5f8bd None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:03.301542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9a7a7137-5417-4e6c-8a20-479f6ff5f8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:03.312468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1218/2405] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:03.388744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1188/2406] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:03.397622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fedfcd-1b63-4e1b-abe4-af0835b2563d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.397988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fedfcd-1b63-4e1b-abe4-af0835b2563d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.398471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fedfcd-1b63-4e1b-abe4-af0835b2563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.417616 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-94fedfcd-1b63-4e1b-abe4-af0835b2563d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:03.418846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-94fedfcd-1b63-4e1b-abe4-af0835b2563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:03.430410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1219/2407] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:03.431773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a7137-5417-4e6c-8a20-479f6ff5f8bd None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:03.443369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a7137-5417-4e6c-8a20-479f6ff5f8bd None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:03.448304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cfdbf-8ac3-449c-98f4-e53ef2f81ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:03.448976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cfdbf-8ac3-449c-98f4-e53ef2f81ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.449265 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cfdbf-8ac3-449c-98f4-e53ef2f81ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.449554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cfdbf-8ac3-449c-98f4-e53ef2f81ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.450524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cfdbf-8ac3-449c-98f4-e53ef2f81ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:03.450989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cfdbf-8ac3-449c-98f4-e53ef2f81ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:03.452784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cfdbf-8ac3-449c-98f4-e53ef2f81ac7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:03.465846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1189/2408] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:57:03.470386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fedfcd-1b63-4e1b-abe4-af0835b2563d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:03.480691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fedfcd-1b63-4e1b-abe4-af0835b2563d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:03.486298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b225d-8569-4937-93c2-a1505389d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:03.486959 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b225d-8569-4937-93c2-a1505389d5bb admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.487253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b225d-8569-4937-93c2-a1505389d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.487582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b225d-8569-4937-93c2-a1505389d5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.488313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b225d-8569-4937-93c2-a1505389d5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:03.491378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b225d-8569-4937-93c2-a1505389d5bb admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:03.678517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1220/2409] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:03 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:03.680010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cfdbf-8ac3-449c-98f4-e53ef2f81ac7 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:03.692128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cfdbf-8ac3-449c-98f4-e53ef2f81ac7 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:03.755023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb45f5-4941-4266-8db1-077d982cee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:03.755710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb45f5-4941-4266-8db1-077d982cee27 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.756002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb45f5-4941-4266-8db1-077d982cee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.756286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb45f5-4941-4266-8db1-077d982cee27 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.756998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb45f5-4941-4266-8db1-077d982cee27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:03.758980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb45f5-4941-4266-8db1-077d982cee27 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:03.824500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:03.863134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1190/2410] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:03 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:03.864865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b225d-8569-4937-93c2-a1505389d5bb admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:03.875144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b225d-8569-4937-93c2-a1505389d5bb admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:03.880419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f3e5-4f5c-48fb-a637-a0a3541bd66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:03.881473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f3e5-4f5c-48fb-a637-a0a3541bd66d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.881473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f3e5-4f5c-48fb-a637-a0a3541bd66d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.881710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f3e5-4f5c-48fb-a637-a0a3541bd66d admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.882367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925f3e5-4f5c-48fb-a637-a0a3541bd66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:03.883965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925f3e5-4f5c-48fb-a637-a0a3541bd66d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:03.898478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1221/2411] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:03.899508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb45f5-4941-4266-8db1-077d982cee27 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:03.909781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb45f5-4941-4266-8db1-077d982cee27 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:03.914608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ae2b8-f18b-4920-8755-1a97acb2f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:03.916527 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ae2b8-f18b-4920-8755-1a97acb2f54e admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.916812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ae2b8-f18b-4920-8755-1a97acb2f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.917092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ae2b8-f18b-4920-8755-1a97acb2f54e admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.917828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ae2b8-f18b-4920-8755-1a97acb2f54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:03.919545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ae2b8-f18b-4920-8755-1a97acb2f54e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:03.930512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1191/2412] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:57:03.934370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f3e5-4f5c-48fb-a637-a0a3541bd66d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:03.944771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f3e5-4f5c-48fb-a637-a0a3541bd66d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:03.949473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370d66-f35f-4149-a89b-9a841a71bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:03.951400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370d66-f35f-4149-a89b-9a841a71bab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:03.951400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370d66-f35f-4149-a89b-9a841a71bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:03.951400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370d66-f35f-4149-a89b-9a841a71bab0 admin admin] PATH_INFO: `/v3/projects/c7684034aeb54f459f1f660f9aa44e61/users/84865ad79da3466e9509a6b08d7f5d68/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:03.966175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa370d66-f35f-4149-a89b-9a841a71bab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7684034aeb54f459f1f660f9aa44e61, user_id=84865ad79da3466e9509a6b08d7f5d68, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:03.968802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa370d66-f35f-4149-a89b-9a841a71bab0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:04.064569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1222/2413] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:03 2022] PUT /identity/v3/projects/c7684034aeb54f459f1f660f9aa44e61/users/84865ad79da3466e9509a6b08d7f5d68/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:04.076233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3a4bd-21d6-4955-88b3-8bb82a963f64 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:04.076537 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3a4bd-21d6-4955-88b3-8bb82a963f64 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:04.076967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3a4bd-21d6-4955-88b3-8bb82a963f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:04.105243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-55e3a4bd-21d6-4955-88b3-8bb82a963f64 None None] MFA Rules not processed for user `84865ad79da3466e9509a6b08d7f5d68`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:04.106533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-55e3a4bd-21d6-4955-88b3-8bb82a963f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:04.184332 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1192/2414] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:04.190188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370d66-f35f-4149-a89b-9a841a71bab0 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:04.192787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fa370d66-f35f-4149-a89b-9a841a71bab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:04.251625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370d66-f35f-4149-a89b-9a841a71bab0 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:04.256311 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3209b2-51b7-42f2-af41-a9f6c75a039f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e839d1074f24a5ba7a552472e167067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:04.257078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3209b2-51b7-42f2-af41-a9f6c75a039f service glance] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:04.257437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3209b2-51b7-42f2-af41-a9f6c75a039f service glance] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:04.257786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3209b2-51b7-42f2-af41-a9f6c75a039f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:04.267202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3209b2-51b7-42f2-af41-a9f6c75a039f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:04.268939 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3209b2-51b7-42f2-af41-a9f6c75a039f service glance] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:04.279505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1223/2415] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:04.330694 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:04.430141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:04.487487 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:06.031602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d0f0-02db-423d-a0bf-25d263b965f9 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:06.032233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d0f0-02db-423d-a0bf-25d263b965f9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:06.032233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d0f0-02db-423d-a0bf-25d263b965f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:06.050647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-0f50d0f0-02db-423d-a0bf-25d263b965f9 None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:06.051923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-0f50d0f0-02db-423d-a0bf-25d263b965f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:06.109831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1193/2416] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:06.123743 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3209b2-51b7-42f2-af41-a9f6c75a039f service glance] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:06.125184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ef3209b2-51b7-42f2-af41-a9f6c75a039f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:06.207817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3209b2-51b7-42f2-af41-a9f6c75a039f service glance] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:06.213490 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229924e6-04d7-400b-b88a-674334b7cf67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:06.214243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229924e6-04d7-400b-b88a-674334b7cf67 service swift] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:06.214538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229924e6-04d7-400b-b88a-674334b7cf67 service swift] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:06.214823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229924e6-04d7-400b-b88a-674334b7cf67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:06.224053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229924e6-04d7-400b-b88a-674334b7cf67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:06.225664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229924e6-04d7-400b-b88a-674334b7cf67 service swift] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:06.233954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1224/2417] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:57:09.610014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50d0f0-02db-423d-a0bf-25d263b965f9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:09.610014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-0f50d0f0-02db-423d-a0bf-25d263b965f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:09.695826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50d0f0-02db-423d-a0bf-25d263b965f9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:09.702311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:09.702666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:09.702946 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:09.703398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] PATH_INFO: `/v3/users/abda9898d977453ab8e11a5b7625394e` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:09.705013 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abda9898d977453ab8e11a5b7625394e)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:09.707513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:09.912433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abda9898d977453ab8e11a5b7625394e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.001272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abda9898d977453ab8e11a5b7625394e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.001891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abda9898d977453ab8e11a5b7625394e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.021361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abda9898d977453ab8e11a5b7625394e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.022250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abda9898d977453ab8e11a5b7625394e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.036827 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1194/2418] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:09 2022] DELETE /identity/v3/users/abda9898d977453ab8e11a5b7625394e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:10.041368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d4765-1c87-4e3d-985b-a04b40c842ee None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:10.041852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d4765-1c87-4e3d-985b-a04b40c842ee None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:10.044722 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d4765-1c87-4e3d-985b-a04b40c842ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:10.064798 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-290d4765-1c87-4e3d-985b-a04b40c842ee None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:10.066147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-290d4765-1c87-4e3d-985b-a04b40c842ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:10.139124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1225/2419] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:10.149696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:10.151145 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:10.160506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:10.211793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377cc3f-dac3-408a-9966-050c4ab724e9 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:10.216050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b17a33-4f76-4e1d-974d-ddece588d344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:10.216700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17a33-4f76-4e1d-974d-ddece588d344 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:10.216985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17a33-4f76-4e1d-974d-ddece588d344 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:10.217262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17a33-4f76-4e1d-974d-ddece588d344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:10.228398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b17a33-4f76-4e1d-974d-ddece588d344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:10.230770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b17a33-4f76-4e1d-974d-ddece588d344 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:10.243765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1195/2420] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:10.700073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d4765-1c87-4e3d-985b-a04b40c842ee None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:10.701752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-290d4765-1c87-4e3d-985b-a04b40c842ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:10.718159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d4765-1c87-4e3d-985b-a04b40c842ee None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:10.723886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:10.724980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:10.725286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:10.725618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] PATH_INFO: `/v3/projects/a2e66781eb794b01be86b49358215559` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:10.727001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e66781eb794b01be86b49358215559)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:10.733589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:10.807333 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:10.814540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e66781eb794b01be86b49358215559', 'request_id': 'req-6d265353-7e06-46f6-b24d-960d9a6fea41'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.869875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e66781eb794b01be86b49358215559', 'request_id': 'req-6d265353-7e06-46f6-b24d-960d9a6fea41'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.876893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e66781eb794b01be86b49358215559', 'request_id': 'req-6d265353-7e06-46f6-b24d-960d9a6fea41'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.888573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] The token cache is being invalidate because project a2e66781eb794b01be86b49358215559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:10.888857 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.889501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6d265353-7e06-46f6-b24d-960d9a6fea41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:10.895246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1226/2421] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:10 2022] DELETE /identity/v3/projects/a2e66781eb794b01be86b49358215559 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:10.900041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57594-f2ea-4416-9630-427b53fdfe38 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:10.900556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57594-f2ea-4416-9630-427b53fdfe38 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:10.901141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57594-f2ea-4416-9630-427b53fdfe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:10.917817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c3a57594-f2ea-4416-9630-427b53fdfe38 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:10.919040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c3a57594-f2ea-4416-9630-427b53fdfe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:10.981412 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1196/2422] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:10.989662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98eb0a-38e8-47ca-9bbe-516d8ff9e1a8 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:10.989985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98eb0a-38e8-47ca-9bbe-516d8ff9e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:10.990277 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98eb0a-38e8-47ca-9bbe-516d8ff9e1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.010283 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-da98eb0a-38e8-47ca-9bbe-516d8ff9e1a8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:11.011517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-da98eb0a-38e8-47ca-9bbe-516d8ff9e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:11.019559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1227/2423] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:11.023944 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a57594-f2ea-4416-9630-427b53fdfe38 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:11.034101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a57594-f2ea-4416-9630-427b53fdfe38 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:11.038928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fba4-ba28-4b59-96ce-697dce2df291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:11.039594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fba4-ba28-4b59-96ce-697dce2df291 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:11.039881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fba4-ba28-4b59-96ce-697dce2df291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:11.040164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fba4-ba28-4b59-96ce-697dce2df291 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.040959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009fba4-ba28-4b59-96ce-697dce2df291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:11.041278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009fba4-ba28-4b59-96ce-697dce2df291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:11.042935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009fba4-ba28-4b59-96ce-697dce2df291 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:11.055320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1197/2424] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:57:11.059622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98eb0a-38e8-47ca-9bbe-516d8ff9e1a8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:11.069506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98eb0a-38e8-47ca-9bbe-516d8ff9e1a8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:11.074366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeacfe-3d41-4aa7-8cf7-0769acc62d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:11.074992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeacfe-3d41-4aa7-8cf7-0769acc62d4e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:11.075281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeacfe-3d41-4aa7-8cf7-0769acc62d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:11.075559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeacfe-3d41-4aa7-8cf7-0769acc62d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.076281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeacfe-3d41-4aa7-8cf7-0769acc62d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:11.078232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeacfe-3d41-4aa7-8cf7-0769acc62d4e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:11.192198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1228/2425] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:11 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:11.197869 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fba4-ba28-4b59-96ce-697dce2df291 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:11.208169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fba4-ba28-4b59-96ce-697dce2df291 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:11.266683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9375c83-3587-4c37-bbaa-585ad81cacba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:11.267374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9375c83-3587-4c37-bbaa-585ad81cacba admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:11.267669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9375c83-3587-4c37-bbaa-585ad81cacba admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:11.268003 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9375c83-3587-4c37-bbaa-585ad81cacba admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.268721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9375c83-3587-4c37-bbaa-585ad81cacba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:11.270789 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9375c83-3587-4c37-bbaa-585ad81cacba admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:11.373164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1198/2426] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:11 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:11.377363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeacfe-3d41-4aa7-8cf7-0769acc62d4e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:11.388345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeacfe-3d41-4aa7-8cf7-0769acc62d4e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:11.392970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f0f7f-3022-4484-bbe4-5814348eab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:11.393678 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f0f7f-3022-4484-bbe4-5814348eab7f admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:11.394132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f0f7f-3022-4484-bbe4-5814348eab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:11.394330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f0f7f-3022-4484-bbe4-5814348eab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.395098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f0f7f-3022-4484-bbe4-5814348eab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:11.396719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f0f7f-3022-4484-bbe4-5814348eab7f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:11.412282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1229/2427] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:11.413465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9375c83-3587-4c37-bbaa-585ad81cacba admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:11.423566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9375c83-3587-4c37-bbaa-585ad81cacba admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:11.429318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5a800-6eb5-484e-9929-5e3ecc22aae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:11.430045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a800-6eb5-484e-9929-5e3ecc22aae5 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:11.431510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a800-6eb5-484e-9929-5e3ecc22aae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:11.431510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a800-6eb5-484e-9929-5e3ecc22aae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.431510 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5a800-6eb5-484e-9929-5e3ecc22aae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:11.433035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5a800-6eb5-484e-9929-5e3ecc22aae5 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:11.444682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1199/2428] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:11.448766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f0f7f-3022-4484-bbe4-5814348eab7f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:11.460936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f0f7f-3022-4484-bbe4-5814348eab7f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:11.465905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c404ecc-dd51-4b3a-b9e7-f56d7d05bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:11.466877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c404ecc-dd51-4b3a-b9e7-f56d7d05bb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:11.467161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c404ecc-dd51-4b3a-b9e7-f56d7d05bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:11.467465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c404ecc-dd51-4b3a-b9e7-f56d7d05bb5d admin admin] PATH_INFO: `/v3/projects/4199a2f39a1d4b2aa2ebfda6fd5fb6ba/users/69b61fc083db45f9b9aeb1d1d6e03884/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.484253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c404ecc-dd51-4b3a-b9e7-f56d7d05bb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4199a2f39a1d4b2aa2ebfda6fd5fb6ba, user_id=69b61fc083db45f9b9aeb1d1d6e03884, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:11.488900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c404ecc-dd51-4b3a-b9e7-f56d7d05bb5d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:11.605538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1230/2429] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:11 2022] PUT /identity/v3/projects/4199a2f39a1d4b2aa2ebfda6fd5fb6ba/users/69b61fc083db45f9b9aeb1d1d6e03884/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:11.617653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e9347-343e-4976-8be9-e459ca677b6b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:11.617973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e9347-343e-4976-8be9-e459ca677b6b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:11.618264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e9347-343e-4976-8be9-e459ca677b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.641809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:11.645519 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4c4e9347-343e-4976-8be9-e459ca677b6b None None] MFA Rules not processed for user `69b61fc083db45f9b9aeb1d1d6e03884`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:11.646804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4c4e9347-343e-4976-8be9-e459ca677b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:11.714003 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1200/2430] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:11.718821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c404ecc-dd51-4b3a-b9e7-f56d7d05bb5d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:11.781398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c404ecc-dd51-4b3a-b9e7-f56d7d05bb5d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:11.786822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ac005-bf96-4fdf-8f49-951986f93cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:11.787486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ac005-bf96-4fdf-8f49-951986f93cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:11.787776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ac005-bf96-4fdf-8f49-951986f93cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:11.788059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ac005-bf96-4fdf-8f49-951986f93cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.788754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ac005-bf96-4fdf-8f49-951986f93cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:11.790710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ac005-bf96-4fdf-8f49-951986f93cd4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:11.912012 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1231/2431] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:11 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:11.915378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e9347-343e-4976-8be9-e459ca677b6b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:11.926331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e9347-343e-4976-8be9-e459ca677b6b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:11.985449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0004c-b2ca-4abf-902e-ee5c7b81d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:11.986166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0004c-b2ca-4abf-902e-ee5c7b81d708 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:11.986458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0004c-b2ca-4abf-902e-ee5c7b81d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:11.986740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0004c-b2ca-4abf-902e-ee5c7b81d708 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:11.987438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0004c-b2ca-4abf-902e-ee5c7b81d708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:11.989414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0004c-b2ca-4abf-902e-ee5c7b81d708 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:12.099135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1201/2432] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:11 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:12.103041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ac005-bf96-4fdf-8f49-951986f93cd4 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:12.113963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ac005-bf96-4fdf-8f49-951986f93cd4 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:12.118600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf09f0-3f5a-414d-a958-3a99ddbbbedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:12.119275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf09f0-3f5a-414d-a958-3a99ddbbbedb admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:12.119605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf09f0-3f5a-414d-a958-3a99ddbbbedb admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:12.119917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf09f0-3f5a-414d-a958-3a99ddbbbedb admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:12.120628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf09f0-3f5a-414d-a958-3a99ddbbbedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:12.122388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf09f0-3f5a-414d-a958-3a99ddbbbedb admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:12.136180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1232/2433] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:12.140269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0004c-b2ca-4abf-902e-ee5c7b81d708 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:12.151124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0004c-b2ca-4abf-902e-ee5c7b81d708 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:12.155578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b1f99-d8a0-4342-890e-b7c9fd1daf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:12.156446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b1f99-d8a0-4342-890e-b7c9fd1daf79 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:12.156734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b1f99-d8a0-4342-890e-b7c9fd1daf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:12.157015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b1f99-d8a0-4342-890e-b7c9fd1daf79 admin admin] PATH_INFO: `/v3/projects/5be1f8aaa7b84107b236e36fdc439e4e/users/9d58c39e4c764eeb9a5292f16640531a/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:12.172133 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b1f99-d8a0-4342-890e-b7c9fd1daf79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be1f8aaa7b84107b236e36fdc439e4e, user_id=9d58c39e4c764eeb9a5292f16640531a, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:12.174849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b1f99-d8a0-4342-890e-b7c9fd1daf79 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:12.251386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1202/2434] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:12 2022] PUT /identity/v3/projects/5be1f8aaa7b84107b236e36fdc439e4e/users/9d58c39e4c764eeb9a5292f16640531a/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:12.255975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf09f0-3f5a-414d-a958-3a99ddbbbedb admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:12.267142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf09f0-3f5a-414d-a958-3a99ddbbbedb admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:12.294751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:12.325038 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a03802-14a3-4b46-87f5-0efc46f700e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:12.325727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03802-14a3-4b46-87f5-0efc46f700e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:12.326056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03802-14a3-4b46-87f5-0efc46f700e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:12.326612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03802-14a3-4b46-87f5-0efc46f700e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:12.327567 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a03802-14a3-4b46-87f5-0efc46f700e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:12.329655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a03802-14a3-4b46-87f5-0efc46f700e1 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:12.340681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1233/2435] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:12.344931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b1f99-d8a0-4342-890e-b7c9fd1daf79 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:12.355140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b1f99-d8a0-4342-890e-b7c9fd1daf79 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:12.359748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a113-e710-42c1-b3ad-7033e5aa150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:12.360687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a113-e710-42c1-b3ad-7033e5aa150f admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:12.361027 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a113-e710-42c1-b3ad-7033e5aa150f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:12.361262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a113-e710-42c1-b3ad-7033e5aa150f admin admin] PATH_INFO: `/v3/projects/5be1f8aaa7b84107b236e36fdc439e4e/users/9d58c39e4c764eeb9a5292f16640531a/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:12.363306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a113-e710-42c1-b3ad-7033e5aa150f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be1f8aaa7b84107b236e36fdc439e4e, user_id=9d58c39e4c764eeb9a5292f16640531a, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:12.365984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a113-e710-42c1-b3ad-7033e5aa150f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:12.376449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1203/2436] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:12 2022] PUT /identity/v3/projects/5be1f8aaa7b84107b236e36fdc439e4e/users/9d58c39e4c764eeb9a5292f16640531a/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:12.387207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3ba29-faef-4870-89cd-9b6e08af06b9 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:12.387538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3ba29-faef-4870-89cd-9b6e08af06b9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:12.387795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3ba29-faef-4870-89cd-9b6e08af06b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:12.421588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3bf3ba29-faef-4870-89cd-9b6e08af06b9 None None] MFA Rules not processed for user `9d58c39e4c764eeb9a5292f16640531a`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:12.422764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3bf3ba29-faef-4870-89cd-9b6e08af06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:12.502010 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1234/2437] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:12.518081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a113-e710-42c1-b3ad-7033e5aa150f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:12.520391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8ea0a113-e710-42c1-b3ad-7033e5aa150f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:12.599185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a113-e710-42c1-b3ad-7033e5aa150f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:12.602969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1378d4-e860-417e-b35a-1940dfd77900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:12.603622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1378d4-e860-417e-b35a-1940dfd77900 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:12.606233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1378d4-e860-417e-b35a-1940dfd77900 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:12.606233 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1378d4-e860-417e-b35a-1940dfd77900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:12.622602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1378d4-e860-417e-b35a-1940dfd77900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:12.624072 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1378d4-e860-417e-b35a-1940dfd77900 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:12.629024 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:12.635760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1204/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:12.832779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3ba29-faef-4870-89cd-9b6e08af06b9 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:12.843078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3ba29-faef-4870-89cd-9b6e08af06b9 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:12.846771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b1f60-9b48-4219-8171-5d41550fd154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:12.847915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1f60-9b48-4219-8171-5d41550fd154 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:12.848198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1f60-9b48-4219-8171-5d41550fd154 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:12.848471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1f60-9b48-4219-8171-5d41550fd154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:12.906710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1f60-9b48-4219-8171-5d41550fd154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:12.908202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1f60-9b48-4219-8171-5d41550fd154 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:12.917797 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1235/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:13.958247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1378d4-e860-417e-b35a-1940dfd77900 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:13.959725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1b1378d4-e860-417e-b35a-1940dfd77900 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:14.018355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1378d4-e860-417e-b35a-1940dfd77900 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:14.022337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30f2be-bd87-42fc-9c1b-3669d54d7cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:14.023111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30f2be-bd87-42fc-9c1b-3669d54d7cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:14.023403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30f2be-bd87-42fc-9c1b-3669d54d7cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:14.023684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30f2be-bd87-42fc-9c1b-3669d54d7cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:14.025913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1d30f2be-bd87-42fc-9c1b-3669d54d7cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:14.091159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30f2be-bd87-42fc-9c1b-3669d54d7cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:14.092606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30f2be-bd87-42fc-9c1b-3669d54d7cb8 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:14.103011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1205/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:57:17.605818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8e96a-468a-4842-a198-ead2d13b703d None None] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:17.606363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8e96a-468a-4842-a198-ead2d13b703d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:17.606481 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8e96a-468a-4842-a198-ead2d13b703d None None] PATH_INFO: `/` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:17.607954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1236/2441] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jun 30 10:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:57:17.620509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00831d2-a9ef-4c2b-8220-41227c93e94d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:17.620998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00831d2-a9ef-4c2b-8220-41227c93e94d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:17.621122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00831d2-a9ef-4c2b-8220-41227c93e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:17.658004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-a00831d2-a9ef-4c2b-8220-41227c93e94d None None] MFA Rules not processed for user `3238a52a3f6047e0acb0136ab39257e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:17.659213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a00831d2-a9ef-4c2b-8220-41227c93e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:17.722437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1206/2442] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jun 30 10:57:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:17.734650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8e96a-468a-4842-a198-ead2d13b703d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:17.736432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ebf8e96a-468a-4842-a198-ead2d13b703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:17.756340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8e96a-468a-4842-a198-ead2d13b703d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:17.766410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00831d2-a9ef-4c2b-8220-41227c93e94d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:17.766537 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c815d-56de-407d-8fd6-7e26c43cced5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3238a52a3f6047e0acb0136ab39257e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:17.767313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c815d-56de-407d-8fd6-7e26c43cced5 service placement] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:17.768319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c815d-56de-407d-8fd6-7e26c43cced5 service placement] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:17.768836 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c815d-56de-407d-8fd6-7e26c43cced5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:17.769632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-a00831d2-a9ef-4c2b-8220-41227c93e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:17.783955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00831d2-a9ef-4c2b-8220-41227c93e94d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:17.787030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c815d-56de-407d-8fd6-7e26c43cced5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:17.788666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c815d-56de-407d-8fd6-7e26c43cced5 service placement] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:17.789363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:17.790254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:17.790533 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:17.790806 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] PATH_INFO: `/v3/users/52599ae5d7a045e6b6156352322e5642` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:17.791991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52599ae5d7a045e6b6156352322e5642)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:17.793963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:17.798680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1237/2443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:17.893304 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:17.965112 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52599ae5d7a045e6b6156352322e5642'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.030009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52599ae5d7a045e6b6156352322e5642'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.030793 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52599ae5d7a045e6b6156352322e5642'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.052134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52599ae5d7a045e6b6156352322e5642'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.052976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bbdb2a8a-64cf-4459-910e-2905c6f807e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52599ae5d7a045e6b6156352322e5642'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.067908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1207/2444] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:17 2022] DELETE /identity/v3/users/52599ae5d7a045e6b6156352322e5642 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:18.338920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c815d-56de-407d-8fd6-7e26c43cced5 service placement] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:18.366036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c815d-56de-407d-8fd6-7e26c43cced5 service placement] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:18.402046 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:18.429069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:18.430000 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:18.430335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:18.430570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] PATH_INFO: `/v3/projects/58aac7897501457a9469852ffcdcc29c` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:18.432240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58aac7897501457a9469852ffcdcc29c)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:18.434469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:18.544596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58aac7897501457a9469852ffcdcc29c', 'request_id': 'req-0313403d-9351-466e-9a61-3c6ec7507b3a'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.601022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58aac7897501457a9469852ffcdcc29c', 'request_id': 'req-0313403d-9351-466e-9a61-3c6ec7507b3a'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.607814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58aac7897501457a9469852ffcdcc29c', 'request_id': 'req-0313403d-9351-466e-9a61-3c6ec7507b3a'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.619621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] The token cache is being invalidate because project 58aac7897501457a9469852ffcdcc29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:18.619979 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.620645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0313403d-9351-466e-9a61-3c6ec7507b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:18.622230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1238/2445] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:18 2022] DELETE /identity/v3/projects/58aac7897501457a9469852ffcdcc29c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:18.627149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de90d2-42b2-445b-9ad5-954df67603da None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:18.627641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de90d2-42b2-445b-9ad5-954df67603da None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:18.627734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de90d2-42b2-445b-9ad5-954df67603da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:18.646046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-01de90d2-42b2-445b-9ad5-954df67603da None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:18.647258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-01de90d2-42b2-445b-9ad5-954df67603da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:18.706728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1208/2446] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:18.715033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ace7be-8092-4724-93c5-5412392340ea None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:18.715361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ace7be-8092-4724-93c5-5412392340ea None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:18.715902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ace7be-8092-4724-93c5-5412392340ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:18.734621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d8ace7be-8092-4724-93c5-5412392340ea None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:18.735777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d8ace7be-8092-4724-93c5-5412392340ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:18.743529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1239/2447] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:18.747762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de90d2-42b2-445b-9ad5-954df67603da None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:18.758028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de90d2-42b2-445b-9ad5-954df67603da None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:18.762536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85841c34-9063-4ff7-8404-73ba283fff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:18.763209 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85841c34-9063-4ff7-8404-73ba283fff91 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:18.763629 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85841c34-9063-4ff7-8404-73ba283fff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:18.763909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85841c34-9063-4ff7-8404-73ba283fff91 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:18.764630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85841c34-9063-4ff7-8404-73ba283fff91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:18.764939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85841c34-9063-4ff7-8404-73ba283fff91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:18.766560 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85841c34-9063-4ff7-8404-73ba283fff91 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:18.778874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1209/2448] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:57:18.783019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ace7be-8092-4724-93c5-5412392340ea None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:18.793715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ace7be-8092-4724-93c5-5412392340ea None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:18.798877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea0483-be37-42ab-8523-8e4ef727295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:18.799530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea0483-be37-42ab-8523-8e4ef727295c admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:18.799844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea0483-be37-42ab-8523-8e4ef727295c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:18.800119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea0483-be37-42ab-8523-8e4ef727295c admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:18.800997 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea0483-be37-42ab-8523-8e4ef727295c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:18.803595 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea0483-be37-42ab-8523-8e4ef727295c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:18.911434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1240/2449] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:18 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:18.915683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85841c34-9063-4ff7-8404-73ba283fff91 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:18.925707 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85841c34-9063-4ff7-8404-73ba283fff91 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:18.987829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd5eb8-352b-4a87-beb6-c3b83ebb0e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:18.988513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd5eb8-352b-4a87-beb6-c3b83ebb0e2d admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:18.988796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd5eb8-352b-4a87-beb6-c3b83ebb0e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:18.989104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd5eb8-352b-4a87-beb6-c3b83ebb0e2d admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:18.989752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd5eb8-352b-4a87-beb6-c3b83ebb0e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:18.991733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd5eb8-352b-4a87-beb6-c3b83ebb0e2d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:19.110117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1210/2450] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:18 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:19.116176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea0483-be37-42ab-8523-8e4ef727295c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:19.127253 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea0483-be37-42ab-8523-8e4ef727295c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:19.132527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abeef1-1e34-441e-a4ee-16c5e1928615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:19.133241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abeef1-1e34-441e-a4ee-16c5e1928615 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:19.133479 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abeef1-1e34-441e-a4ee-16c5e1928615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:19.133755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abeef1-1e34-441e-a4ee-16c5e1928615 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:19.134527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abeef1-1e34-441e-a4ee-16c5e1928615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:19.136119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abeef1-1e34-441e-a4ee-16c5e1928615 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:19.147275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1241/2451] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:19.151297 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd5eb8-352b-4a87-beb6-c3b83ebb0e2d admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:19.161389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd5eb8-352b-4a87-beb6-c3b83ebb0e2d admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:19.166036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1c8bd-c7f5-4fbd-9c43-1e5b02b34194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:19.166696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1c8bd-c7f5-4fbd-9c43-1e5b02b34194 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:19.166986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1c8bd-c7f5-4fbd-9c43-1e5b02b34194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:19.167262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1c8bd-c7f5-4fbd-9c43-1e5b02b34194 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:19.167988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1c8bd-c7f5-4fbd-9c43-1e5b02b34194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:19.169570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1c8bd-c7f5-4fbd-9c43-1e5b02b34194 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:19.180138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1211/2452] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:19.184402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abeef1-1e34-441e-a4ee-16c5e1928615 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:19.194981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abeef1-1e34-441e-a4ee-16c5e1928615 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:19.199525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59e83e-fe43-40df-b2c5-5de65d75624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:19.200391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59e83e-fe43-40df-b2c5-5de65d75624f admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:19.200677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59e83e-fe43-40df-b2c5-5de65d75624f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:19.200958 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59e83e-fe43-40df-b2c5-5de65d75624f admin admin] PATH_INFO: `/v3/projects/8a1828a7cd4f46378aa57d0aee5fa45d/users/5e888692b1ed4a93af30ac96c15c027c/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:19.215381 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59e83e-fe43-40df-b2c5-5de65d75624f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1828a7cd4f46378aa57d0aee5fa45d, user_id=5e888692b1ed4a93af30ac96c15c027c, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:19.218385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59e83e-fe43-40df-b2c5-5de65d75624f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:19.328134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1242/2453] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:19 2022] PUT /identity/v3/projects/8a1828a7cd4f46378aa57d0aee5fa45d/users/5e888692b1ed4a93af30ac96c15c027c/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:19.340076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e968f-d998-4b2b-89bb-1e55ec3c8078 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:19.340370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e968f-d998-4b2b-89bb-1e55ec3c8078 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:19.340909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e968f-d998-4b2b-89bb-1e55ec3c8078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:19.359502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:19.368146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-bd8e968f-d998-4b2b-89bb-1e55ec3c8078 None None] MFA Rules not processed for user `5e888692b1ed4a93af30ac96c15c027c`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:19.369339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bd8e968f-d998-4b2b-89bb-1e55ec3c8078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:19.437536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1212/2454] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:19.448876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59e83e-fe43-40df-b2c5-5de65d75624f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:19.450708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8f59e83e-fe43-40df-b2c5-5de65d75624f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:19.509242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:19.524637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59e83e-fe43-40df-b2c5-5de65d75624f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:19.530248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c39007-aea8-4dbe-bedf-de9159767f12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:19.530885 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c39007-aea8-4dbe-bedf-de9159767f12 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:19.531240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c39007-aea8-4dbe-bedf-de9159767f12 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:19.536691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c39007-aea8-4dbe-bedf-de9159767f12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:19.539301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c39007-aea8-4dbe-bedf-de9159767f12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:19.540916 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c39007-aea8-4dbe-bedf-de9159767f12 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:19.549632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1243/2455] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:19.763085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e968f-d998-4b2b-89bb-1e55ec3c8078 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:19.824252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e968f-d998-4b2b-89bb-1e55ec3c8078 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:19.828692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:19.829556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:19.829845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:19.830154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] PATH_INFO: `/v3/users/5e888692b1ed4a93af30ac96c15c027c` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:19.831334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e888692b1ed4a93af30ac96c15c027c)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:19.833889 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:20.013433 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e888692b1ed4a93af30ac96c15c027c'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.097969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e888692b1ed4a93af30ac96c15c027c'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.098772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e888692b1ed4a93af30ac96c15c027c'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.111512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e888692b1ed4a93af30ac96c15c027c'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.112236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e888692b1ed4a93af30ac96c15c027c'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.125463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1213/2456] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:19 2022] DELETE /identity/v3/users/5e888692b1ed4a93af30ac96c15c027c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:20.130751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8614c1-a127-4ce0-afa6-af9c8f3f1696 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:20.131211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8614c1-a127-4ce0-afa6-af9c8f3f1696 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:20.131340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8614c1-a127-4ce0-afa6-af9c8f3f1696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:20.148221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7a8614c1-a127-4ce0-afa6-af9c8f3f1696 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:20.149368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7a8614c1-a127-4ce0-afa6-af9c8f3f1696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:20.224827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1244/2457] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:20.231513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:20.232953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:20.256293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:20.297550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75f00-76ed-47b1-bc3e-75b510d25d1c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:20.303278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc6ffa-9cee-4eae-921c-73a68bff736b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:20.303940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc6ffa-9cee-4eae-921c-73a68bff736b service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:20.304277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc6ffa-9cee-4eae-921c-73a68bff736b service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:20.304567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc6ffa-9cee-4eae-921c-73a68bff736b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:20.314912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc6ffa-9cee-4eae-921c-73a68bff736b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:20.316347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc6ffa-9cee-4eae-921c-73a68bff736b service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:20.334131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1214/2458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:20.751137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8614c1-a127-4ce0-afa6-af9c8f3f1696 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:20.752545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7a8614c1-a127-4ce0-afa6-af9c8f3f1696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:20.764546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8614c1-a127-4ce0-afa6-af9c8f3f1696 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:20.769227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:20.771612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:20.771612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:20.771612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] PATH_INFO: `/v3/projects/8a1828a7cd4f46378aa57d0aee5fa45d` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:20.772402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1828a7cd4f46378aa57d0aee5fa45d)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:20.774353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:20.882272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1828a7cd4f46378aa57d0aee5fa45d', 'request_id': 'req-c9927b0a-67d6-45c9-8522-c679ae234271'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.953672 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1828a7cd4f46378aa57d0aee5fa45d', 'request_id': 'req-c9927b0a-67d6-45c9-8522-c679ae234271'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.961243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1828a7cd4f46378aa57d0aee5fa45d', 'request_id': 'req-c9927b0a-67d6-45c9-8522-c679ae234271'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.972589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] The token cache is being invalidate because project 8a1828a7cd4f46378aa57d0aee5fa45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:20.972873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.974109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c9927b0a-67d6-45c9-8522-c679ae234271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:20.975719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1245/2459] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:20 2022] DELETE /identity/v3/projects/8a1828a7cd4f46378aa57d0aee5fa45d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:20.980578 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea99936-c7d0-42ee-8dd9-7edfd0ba3177 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:20.981048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea99936-c7d0-42ee-8dd9-7edfd0ba3177 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:20.981146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea99936-c7d0-42ee-8dd9-7edfd0ba3177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:20.998387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-8ea99936-c7d0-42ee-8dd9-7edfd0ba3177 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:20.999586 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8ea99936-c7d0-42ee-8dd9-7edfd0ba3177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:21.059106 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1215/2460] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:21.066905 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469eb6b-df4c-4c80-a445-52989576ec80 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:21.067709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469eb6b-df4c-4c80-a445-52989576ec80 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:21.067995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469eb6b-df4c-4c80-a445-52989576ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:21.086741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a469eb6b-df4c-4c80-a445-52989576ec80 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:21.087947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a469eb6b-df4c-4c80-a445-52989576ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:21.096116 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1246/2461] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:21.100441 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea99936-c7d0-42ee-8dd9-7edfd0ba3177 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:21.110367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea99936-c7d0-42ee-8dd9-7edfd0ba3177 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:21.115074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403fe0-d715-4962-aa41-de628786bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:21.115731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403fe0-d715-4962-aa41-de628786bff1 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:21.116023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403fe0-d715-4962-aa41-de628786bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:21.116306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403fe0-d715-4962-aa41-de628786bff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:21.117034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403fe0-d715-4962-aa41-de628786bff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:21.117348 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403fe0-d715-4962-aa41-de628786bff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:21.119045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403fe0-d715-4962-aa41-de628786bff1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:21.131495 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1216/2462] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:57:21.135754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469eb6b-df4c-4c80-a445-52989576ec80 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:21.145086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469eb6b-df4c-4c80-a445-52989576ec80 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:21.150382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26370-9b1d-4ab7-bd71-5004569b1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:21.151032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26370-9b1d-4ab7-bd71-5004569b1ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:21.151317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26370-9b1d-4ab7-bd71-5004569b1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:21.151597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26370-9b1d-4ab7-bd71-5004569b1ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:21.152299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc26370-9b1d-4ab7-bd71-5004569b1ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:21.154267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc26370-9b1d-4ab7-bd71-5004569b1ec0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:21.247854 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1247/2463] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:21 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:21.252094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403fe0-d715-4962-aa41-de628786bff1 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:21.262513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403fe0-d715-4962-aa41-de628786bff1 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:21.318529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60493-fe30-4b10-af5b-abe2dda471f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:21.319196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60493-fe30-4b10-af5b-abe2dda471f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:21.319491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60493-fe30-4b10-af5b-abe2dda471f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:21.319771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60493-fe30-4b10-af5b-abe2dda471f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:21.320467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c60493-fe30-4b10-af5b-abe2dda471f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:21.322479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c60493-fe30-4b10-af5b-abe2dda471f2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:21.435335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1217/2464] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:21 2022] POST /identity/v3/users => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:21.439265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26370-9b1d-4ab7-bd71-5004569b1ec0 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:21.450317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26370-9b1d-4ab7-bd71-5004569b1ec0 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:21.455039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a2391-e9a2-4b80-9bbb-8e04163f8cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:21.455700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a2391-e9a2-4b80-9bbb-8e04163f8cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:21.455985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a2391-e9a2-4b80-9bbb-8e04163f8cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:21.456269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a2391-e9a2-4b80-9bbb-8e04163f8cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:21.457053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a2391-e9a2-4b80-9bbb-8e04163f8cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:21.458713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a2391-e9a2-4b80-9bbb-8e04163f8cd1 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:21.469374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1248/2465] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:21.473834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60493-fe30-4b10-af5b-abe2dda471f2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:21.484063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60493-fe30-4b10-af5b-abe2dda471f2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:21.488690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c402-1093-46cb-b5cb-d2d8ce69fb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:21.489882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c402-1093-46cb-b5cb-d2d8ce69fb28 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:21.490212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c402-1093-46cb-b5cb-d2d8ce69fb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:21.490500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c402-1093-46cb-b5cb-d2d8ce69fb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:21.491257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3c402-1093-46cb-b5cb-d2d8ce69fb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:21.492861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3c402-1093-46cb-b5cb-d2d8ce69fb28 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:21.502818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1218/2466] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:21.507399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a2391-e9a2-4b80-9bbb-8e04163f8cd1 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:21.517196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a2391-e9a2-4b80-9bbb-8e04163f8cd1 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:21.521722 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753b8c8-dadb-4f11-899b-3171a78e2b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:21.522632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753b8c8-dadb-4f11-899b-3171a78e2b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:21.522914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753b8c8-dadb-4f11-899b-3171a78e2b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:21.528693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753b8c8-dadb-4f11-899b-3171a78e2b4e admin admin] PATH_INFO: `/v3/projects/befd7114693549be9d2c184e7985893e/users/d0720f5328e44fb185041da9efe1a78b/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:21.538259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753b8c8-dadb-4f11-899b-3171a78e2b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=befd7114693549be9d2c184e7985893e, user_id=d0720f5328e44fb185041da9efe1a78b, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:21.540999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753b8c8-dadb-4f11-899b-3171a78e2b4e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:21.645529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1249/2467] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:21 2022] PUT /identity/v3/projects/befd7114693549be9d2c184e7985893e/users/d0720f5328e44fb185041da9efe1a78b/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:21.650700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f140-4b0c-4c0e-8c68-94d5c1e4a683 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:21.651042 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f140-4b0c-4c0e-8c68-94d5c1e4a683 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:21.651328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f140-4b0c-4c0e-8c68-94d5c1e4a683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:21.669513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e740f140-4b0c-4c0e-8c68-94d5c1e4a683 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:21.670733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e740f140-4b0c-4c0e-8c68-94d5c1e4a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:21.692046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:21.737051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1219/2468] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:21.744384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753b8c8-dadb-4f11-899b-3171a78e2b4e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:21.746288 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6753b8c8-dadb-4f11-899b-3171a78e2b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:21.756161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:21.802541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753b8c8-dadb-4f11-899b-3171a78e2b4e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:21.806212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf96992-9f03-4cd3-acfa-4ccef6c812e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:21.806915 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96992-9f03-4cd3-acfa-4ccef6c812e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:21.807200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96992-9f03-4cd3-acfa-4ccef6c812e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:21.807476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96992-9f03-4cd3-acfa-4ccef6c812e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:21.816487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf96992-9f03-4cd3-acfa-4ccef6c812e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:21.817964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf96992-9f03-4cd3-acfa-4ccef6c812e1 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:21.827592 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1250/2469] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:23.133832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e8917-6fb7-47f3-95d4-8d20fe8c473a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:23.133832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e8917-6fb7-47f3-95d4-8d20fe8c473a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:23.133832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e8917-6fb7-47f3-95d4-8d20fe8c473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:23.165198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3c7e8917-6fb7-47f3-95d4-8d20fe8c473a None None] MFA Rules not processed for user `d0720f5328e44fb185041da9efe1a78b`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:23.166703 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3c7e8917-6fb7-47f3-95d4-8d20fe8c473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:23.243460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1220/2470] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:23.248244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf96992-9f03-4cd3-acfa-4ccef6c812e1 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:23.258459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf96992-9f03-4cd3-acfa-4ccef6c812e1 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:23.263021 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4910335-0afa-4fdc-ab15-dd8cb478ead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:23.263676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4910335-0afa-4fdc-ab15-dd8cb478ead8 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:23.263965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4910335-0afa-4fdc-ab15-dd8cb478ead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:23.264245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4910335-0afa-4fdc-ab15-dd8cb478ead8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:23.264940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4910335-0afa-4fdc-ab15-dd8cb478ead8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:23.266895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4910335-0afa-4fdc-ab15-dd8cb478ead8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:23.367533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1251/2471] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:23 2022] POST /identity/v3/projects => generated 405 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:23.371416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e8917-6fb7-47f3-95d4-8d20fe8c473a None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:23.383328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e8917-6fb7-47f3-95d4-8d20fe8c473a None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:23.440590 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61881a66-ffb0-49e0-93b2-3cccfaad99ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:23.441189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61881a66-ffb0-49e0-93b2-3cccfaad99ba admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:23.441479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61881a66-ffb0-49e0-93b2-3cccfaad99ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:23.441758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61881a66-ffb0-49e0-93b2-3cccfaad99ba admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:23.442992 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61881a66-ffb0-49e0-93b2-3cccfaad99ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:23.444904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61881a66-ffb0-49e0-93b2-3cccfaad99ba admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:23.528486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1221/2472] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:23 2022] POST /identity/v3/users => generated 309 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:23.539846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4910335-0afa-4fdc-ab15-dd8cb478ead8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:23.550521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4910335-0afa-4fdc-ab15-dd8cb478ead8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:23.555502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c46b0f-6679-4749-8187-0a9ef05baf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:23.556316 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c46b0f-6679-4749-8187-0a9ef05baf5c admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:23.556560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c46b0f-6679-4749-8187-0a9ef05baf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:23.556838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c46b0f-6679-4749-8187-0a9ef05baf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:23.557765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c46b0f-6679-4749-8187-0a9ef05baf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:23.559517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c46b0f-6679-4749-8187-0a9ef05baf5c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:23.571872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1252/2473] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:23.581183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61881a66-ffb0-49e0-93b2-3cccfaad99ba admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:23.592337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61881a66-ffb0-49e0-93b2-3cccfaad99ba admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:23.596941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c59566-9050-4870-8055-089161ccae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:23.597822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c59566-9050-4870-8055-089161ccae70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:23.598152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c59566-9050-4870-8055-089161ccae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:23.599936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c59566-9050-4870-8055-089161ccae70 admin admin] PATH_INFO: `/v3/projects/2995bf659f494eed841edaab5701ea6f/users/41f85eec4003411fab9cd8b922730f84/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:23.619652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c59566-9050-4870-8055-089161ccae70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2995bf659f494eed841edaab5701ea6f, user_id=41f85eec4003411fab9cd8b922730f84, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:23.622370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c59566-9050-4870-8055-089161ccae70 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:23.704325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1222/2474] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:23 2022] PUT /identity/v3/projects/2995bf659f494eed841edaab5701ea6f/users/41f85eec4003411fab9cd8b922730f84/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:23.708295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c46b0f-6679-4749-8187-0a9ef05baf5c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:23.718746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c46b0f-6679-4749-8187-0a9ef05baf5c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:23.775430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d0156-f47b-45ae-964c-6e3dbd8d632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:23.776100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d0156-f47b-45ae-964c-6e3dbd8d632b admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:23.776387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d0156-f47b-45ae-964c-6e3dbd8d632b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:23.776669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d0156-f47b-45ae-964c-6e3dbd8d632b admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:23.777391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d0156-f47b-45ae-964c-6e3dbd8d632b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:23.779036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d0156-f47b-45ae-964c-6e3dbd8d632b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:23.788971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1253/2475] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:23.793241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c59566-9050-4870-8055-089161ccae70 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:23.804157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c59566-9050-4870-8055-089161ccae70 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:23.808898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af862b-7647-4edc-9e05-3bbe310549ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:23.809809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af862b-7647-4edc-9e05-3bbe310549ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:23.810134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af862b-7647-4edc-9e05-3bbe310549ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:23.810416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af862b-7647-4edc-9e05-3bbe310549ed admin admin] PATH_INFO: `/v3/projects/2995bf659f494eed841edaab5701ea6f/users/41f85eec4003411fab9cd8b922730f84/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:23.812425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af862b-7647-4edc-9e05-3bbe310549ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2995bf659f494eed841edaab5701ea6f, user_id=41f85eec4003411fab9cd8b922730f84, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:23.815202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af862b-7647-4edc-9e05-3bbe310549ed admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:23.826127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1223/2476] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:23 2022] PUT /identity/v3/projects/2995bf659f494eed841edaab5701ea6f/users/41f85eec4003411fab9cd8b922730f84/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:25.061282 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8fe9-dcd6-4909-b2de-434d008acbac None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:25.062358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8fe9-dcd6-4909-b2de-434d008acbac None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:25.062642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8fe9-dcd6-4909-b2de-434d008acbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:25.090155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-273e8fe9-dcd6-4909-b2de-434d008acbac None None] MFA Rules not processed for user `41f85eec4003411fab9cd8b922730f84`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:25.091705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-273e8fe9-dcd6-4909-b2de-434d008acbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:25.162259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:25.167461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1254/2477] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:25.906009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af862b-7647-4edc-9e05-3bbe310549ed admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:25.907821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-98af862b-7647-4edc-9e05-3bbe310549ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:25.923373 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:25.995924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af862b-7647-4edc-9e05-3bbe310549ed admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:26.001331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bb59e-8ef4-4cd2-b7e8-41806ef58097 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3238a52a3f6047e0acb0136ab39257e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:26.002019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb59e-8ef4-4cd2-b7e8-41806ef58097 service placement] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:26.002312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb59e-8ef4-4cd2-b7e8-41806ef58097 service placement] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:26.002588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb59e-8ef4-4cd2-b7e8-41806ef58097 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:26.004314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-326bb59e-8ef4-4cd2-b7e8-41806ef58097 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:26.016231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bb59e-8ef4-4cd2-b7e8-41806ef58097 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:26.017918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bb59e-8ef4-4cd2-b7e8-41806ef58097 service placement] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:26.027937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1224/2478] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:26.700870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e8fe9-dcd6-4909-b2de-434d008acbac None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:26.769615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e8fe9-dcd6-4909-b2de-434d008acbac None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:26.774969 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:26.775865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:26.776147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:26.776421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] PATH_INFO: `/v3/users/d0720f5328e44fb185041da9efe1a78b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:26.777607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0720f5328e44fb185041da9efe1a78b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:26.779774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:26.946162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0720f5328e44fb185041da9efe1a78b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.006868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0720f5328e44fb185041da9efe1a78b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.025346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0720f5328e44fb185041da9efe1a78b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.026350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0720f5328e44fb185041da9efe1a78b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.033602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0720f5328e44fb185041da9efe1a78b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.039700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1255/2479] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:26 2022] DELETE /identity/v3/users/d0720f5328e44fb185041da9efe1a78b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:27.517351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bb59e-8ef4-4cd2-b7e8-41806ef58097 service placement] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:27.528760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bb59e-8ef4-4cd2-b7e8-41806ef58097 service placement] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:27.590520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:27.591650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:27.591937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:27.592215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] PATH_INFO: `/v3/projects/befd7114693549be9d2c184e7985893e` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:27.593387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=befd7114693549be9d2c184e7985893e)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:27.595422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:27.709172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'befd7114693549be9d2c184e7985893e', 'request_id': 'req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.715420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'befd7114693549be9d2c184e7985893e', 'request_id': 'req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.816520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'befd7114693549be9d2c184e7985893e', 'request_id': 'req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.827492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] The token cache is being invalidate because project befd7114693549be9d2c184e7985893e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:27.827777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.828403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:27.829962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1225/2480] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:27 2022] DELETE /identity/v3/projects/befd7114693549be9d2c184e7985893e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:27.833868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:27.835550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:27.849077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035ebe8-1264-4ce1-b665-cbaab1b6914f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:27.915931 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:27.927059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:27.927059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:27.927059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] PATH_INFO: `/v3/users/41f85eec4003411fab9cd8b922730f84` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:27.927059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f85eec4003411fab9cd8b922730f84)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:27.927059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:27.943872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:28.140966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f85eec4003411fab9cd8b922730f84'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.224324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f85eec4003411fab9cd8b922730f84'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.237054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f85eec4003411fab9cd8b922730f84'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.237718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f85eec4003411fab9cd8b922730f84'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.245539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f85eec4003411fab9cd8b922730f84'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.252326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1256/2481] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:27 2022] DELETE /identity/v3/users/41f85eec4003411fab9cd8b922730f84 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:28.511782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:28.513339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:28.526876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1b9e2-bb79-4f0d-844f-7424a3dab5e7 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:28.555940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:28.587807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:28.588714 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:28.588999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:28.589278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] PATH_INFO: `/v3/projects/2995bf659f494eed841edaab5701ea6f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:28.591115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=2995bf659f494eed841edaab5701ea6f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:28.593308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:28.705848 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2995bf659f494eed841edaab5701ea6f', 'request_id': 'req-93487df3-0b4c-4090-837e-bfa4b5281dda'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.714923 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:28.716952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:28.718693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2995bf659f494eed841edaab5701ea6f', 'request_id': 'req-93487df3-0b4c-4090-837e-bfa4b5281dda'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.730210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae65d5-07c9-4587-a942-7796f37e5d5c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:28.787710 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:28.788561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:28.788845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:28.789118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] PATH_INFO: `/v3/users/84865ad79da3466e9509a6b08d7f5d68` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:28.790358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84865ad79da3466e9509a6b08d7f5d68)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:28.795047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:28.812414 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2995bf659f494eed841edaab5701ea6f', 'request_id': 'req-93487df3-0b4c-4090-837e-bfa4b5281dda'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.824396 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] The token cache is being invalidate because project 2995bf659f494eed841edaab5701ea6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:28.827658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.827658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93487df3-0b4c-4090-837e-bfa4b5281dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:28.827658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1226/2482] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:28 2022] DELETE /identity/v3/projects/2995bf659f494eed841edaab5701ea6f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:28.831669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ce5f1-39fd-4ad4-b958-0fc326a56276 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:28.831955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ce5f1-39fd-4ad4-b958-0fc326a56276 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:28.832230 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ce5f1-39fd-4ad4-b958-0fc326a56276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:28.851392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-323ce5f1-39fd-4ad4-b958-0fc326a56276 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:28.852628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-323ce5f1-39fd-4ad4-b958-0fc326a56276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:28.860651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1227/2483] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:28.868671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb10752-4895-4149-b1dc-b418474b75a0 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:28.868969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb10752-4895-4149-b1dc-b418474b75a0 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:28.869250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb10752-4895-4149-b1dc-b418474b75a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:28.888099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-8bb10752-4895-4149-b1dc-b418474b75a0 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:28.889708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8bb10752-4895-4149-b1dc-b418474b75a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:28.898802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1228/2484] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:28.902894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb10752-4895-4149-b1dc-b418474b75a0 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:28.911938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb10752-4895-4149-b1dc-b418474b75a0 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:28.916566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963e22e-cacc-428b-bc5d-5ea14ebda026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:28.917210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963e22e-cacc-428b-bc5d-5ea14ebda026 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:28.917501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963e22e-cacc-428b-bc5d-5ea14ebda026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:28.917784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963e22e-cacc-428b-bc5d-5ea14ebda026 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:28.918555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963e22e-cacc-428b-bc5d-5ea14ebda026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:28.918870 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963e22e-cacc-428b-bc5d-5ea14ebda026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:28.920473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963e22e-cacc-428b-bc5d-5ea14ebda026 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:28.933037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1229/2485] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:57:28.937250 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963e22e-cacc-428b-bc5d-5ea14ebda026 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:28.947162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963e22e-cacc-428b-bc5d-5ea14ebda026 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:28.951942 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0b9a-4fa8-4bbc-b2d5-85d75b44c162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:28.952556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0b9a-4fa8-4bbc-b2d5-85d75b44c162 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:28.952904 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0b9a-4fa8-4bbc-b2d5-85d75b44c162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:28.953170 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0b9a-4fa8-4bbc-b2d5-85d75b44c162 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:28.953918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0b9a-4fa8-4bbc-b2d5-85d75b44c162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:28.959602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0b9a-4fa8-4bbc-b2d5-85d75b44c162 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:28.985870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84865ad79da3466e9509a6b08d7f5d68'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.036813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1230/2486] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:28 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:29.040512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0b9a-4fa8-4bbc-b2d5-85d75b44c162 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:29.047044 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84865ad79da3466e9509a6b08d7f5d68'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.061391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84865ad79da3466e9509a6b08d7f5d68'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.064190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84865ad79da3466e9509a6b08d7f5d68'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.070115 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5a7c7d14-13ae-4691-8ad0-9dd6c9792862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84865ad79da3466e9509a6b08d7f5d68'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.076858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1257/2487] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:28 2022] DELETE /identity/v3/users/84865ad79da3466e9509a6b08d7f5d68 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:29.080746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6d803-c538-4305-9139-859a91f8a683 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.081401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6d803-c538-4305-9139-859a91f8a683 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.081401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6d803-c538-4305-9139-859a91f8a683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.098099 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-08a6d803-c538-4305-9139-859a91f8a683 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:29.099338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-08a6d803-c538-4305-9139-859a91f8a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:29.103845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0b9a-4fa8-4bbc-b2d5-85d75b44c162 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:29.109014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:29.121591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:29.160131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1258/2488] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:29.161141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82772f5d-b684-4e4c-93e3-a204d1717ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:29.161829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82772f5d-b684-4e4c-93e3-a204d1717ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.162151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82772f5d-b684-4e4c-93e3-a204d1717ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.162448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82772f5d-b684-4e4c-93e3-a204d1717ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.163142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82772f5d-b684-4e4c-93e3-a204d1717ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:29.165179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82772f5d-b684-4e4c-93e3-a204d1717ef3 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:29.170101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6d803-c538-4305-9139-859a91f8a683 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:29.171769 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-08a6d803-c538-4305-9139-859a91f8a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:29.228302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6d803-c538-4305-9139-859a91f8a683 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:29.231903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fa65-5fbd-4a4d-9ee0-3c5a01ba9674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:29.232535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fa65-5fbd-4a4d-9ee0-3c5a01ba9674 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.232818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fa65-5fbd-4a4d-9ee0-3c5a01ba9674 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.233092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fa65-5fbd-4a4d-9ee0-3c5a01ba9674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.242554 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798fa65-5fbd-4a4d-9ee0-3c5a01ba9674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:29.243982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798fa65-5fbd-4a4d-9ee0-3c5a01ba9674 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:29.255502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1231/2489] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:29 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:29.256054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1259/2490] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:57:29.256576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fa65-5fbd-4a4d-9ee0-3c5a01ba9674 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:29.257955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7798fa65-5fbd-4a4d-9ee0-3c5a01ba9674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:29.270461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fa65-5fbd-4a4d-9ee0-3c5a01ba9674 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:29.275236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ca40b-7b03-461c-a149-232f9b8588dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:29.276132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ca40b-7b03-461c-a149-232f9b8588dd admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.276422 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ca40b-7b03-461c-a149-232f9b8588dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.277425 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ca40b-7b03-461c-a149-232f9b8588dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.278189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ca40b-7b03-461c-a149-232f9b8588dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:29.279903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ca40b-7b03-461c-a149-232f9b8588dd admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:29.293279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1260/2491] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:29.294690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82772f5d-b684-4e4c-93e3-a204d1717ef3 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:29.305362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82772f5d-b684-4e4c-93e3-a204d1717ef3 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:29.310453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc476c-7922-4575-b7ce-12062527f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:29.311229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc476c-7922-4575-b7ce-12062527f393 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.311588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc476c-7922-4575-b7ce-12062527f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.311941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc476c-7922-4575-b7ce-12062527f393 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.312788 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc476c-7922-4575-b7ce-12062527f393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:29.314573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc476c-7922-4575-b7ce-12062527f393 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:29.327916 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1232/2492] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:29.335060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ca40b-7b03-461c-a149-232f9b8588dd admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:29.345768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ca40b-7b03-461c-a149-232f9b8588dd admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:29.351290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0bc08-6c35-499d-b90a-6869f03b7b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:29.352169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0bc08-6c35-499d-b90a-6869f03b7b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.352453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0bc08-6c35-499d-b90a-6869f03b7b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.352729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0bc08-6c35-499d-b90a-6869f03b7b90 admin admin] PATH_INFO: `/v3/projects/10a5764e46ed42488ebc71d54855fb13/users/ead7dddbc18b4d8d8886a13b65f1035c/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.368001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0bc08-6c35-499d-b90a-6869f03b7b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a5764e46ed42488ebc71d54855fb13, user_id=ead7dddbc18b4d8d8886a13b65f1035c, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:29.370828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0bc08-6c35-499d-b90a-6869f03b7b90 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:29.459752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1261/2493] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:29 2022] PUT /identity/v3/projects/10a5764e46ed42488ebc71d54855fb13/users/ead7dddbc18b4d8d8886a13b65f1035c/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:29.470039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b16f-4965-4c55-a6bd-293983748462 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.470338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b16f-4965-4c55-a6bd-293983748462 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.470626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b16f-4965-4c55-a6bd-293983748462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.499486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2b08b16f-4965-4c55-a6bd-293983748462 None None] MFA Rules not processed for user `ead7dddbc18b4d8d8886a13b65f1035c`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:29.500750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2b08b16f-4965-4c55-a6bd-293983748462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:29.566257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1233/2494] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:29.570938 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0bc08-6c35-499d-b90a-6869f03b7b90 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:29.635735 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0bc08-6c35-499d-b90a-6869f03b7b90 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:29.640330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c949fba-fd7a-4c93-8c72-6e16ab5620e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:29.640981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c949fba-fd7a-4c93-8c72-6e16ab5620e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.641266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c949fba-fd7a-4c93-8c72-6e16ab5620e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.641543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c949fba-fd7a-4c93-8c72-6e16ab5620e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.642372 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c949fba-fd7a-4c93-8c72-6e16ab5620e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:29.644281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c949fba-fd7a-4c93-8c72-6e16ab5620e5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:29.682649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08b16f-4965-4c55-a6bd-293983748462 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:29.684077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2b08b16f-4965-4c55-a6bd-293983748462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:29.697920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08b16f-4965-4c55-a6bd-293983748462 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:29.702811 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:29.703753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.703915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.704187 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] PATH_INFO: `/v3/projects/c7684034aeb54f459f1f660f9aa44e61` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.705401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7684034aeb54f459f1f660f9aa44e61)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:29.707985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:29.748444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1262/2495] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:29 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:29.750321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c949fba-fd7a-4c93-8c72-6e16ab5620e5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:29.761481 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:29.815036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c949fba-fd7a-4c93-8c72-6e16ab5620e5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:29.819810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a488b-a39e-4457-9b20-0875f32704f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:29.820479 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a488b-a39e-4457-9b20-0875f32704f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.820774 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a488b-a39e-4457-9b20-0875f32704f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.821055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a488b-a39e-4457-9b20-0875f32704f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.821752 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a488b-a39e-4457-9b20-0875f32704f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:29.823739 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a488b-a39e-4457-9b20-0875f32704f7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:29.843237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7684034aeb54f459f1f660f9aa44e61', 'request_id': 'req-5cf2fade-9d02-4f4c-92f8-328873dd3e92'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.850038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7684034aeb54f459f1f660f9aa44e61', 'request_id': 'req-5cf2fade-9d02-4f4c-92f8-328873dd3e92'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.922711 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7684034aeb54f459f1f660f9aa44e61', 'request_id': 'req-5cf2fade-9d02-4f4c-92f8-328873dd3e92'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.928484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1263/2496] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:29 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:29.932502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a488b-a39e-4457-9b20-0875f32704f7 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:29.939146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] The token cache is being invalidate because project c7684034aeb54f459f1f660f9aa44e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:29.939620 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.940752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5cf2fade-9d02-4f4c-92f8-328873dd3e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:29.942961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1234/2497] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:29 2022] DELETE /identity/v3/projects/c7684034aeb54f459f1f660f9aa44e61 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:29.944117 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a488b-a39e-4457-9b20-0875f32704f7 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:29.947717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5e849-464e-4b7c-8fd9-6c26460ca5c5 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:29.948274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5e849-464e-4b7c-8fd9-6c26460ca5c5 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:29.948777 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5e849-464e-4b7c-8fd9-6c26460ca5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:29.968911 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c3a5e849-464e-4b7c-8fd9-6c26460ca5c5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:29.970184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c3a5e849-464e-4b7c-8fd9-6c26460ca5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:29.975182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:30.007198 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7da2-a433-4dcf-9360-0ec452bada7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.012674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7da2-a433-4dcf-9360-0ec452bada7e admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.012674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7da2-a433-4dcf-9360-0ec452bada7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.012674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7da2-a433-4dcf-9360-0ec452bada7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.012674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7da2-a433-4dcf-9360-0ec452bada7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.012674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7da2-a433-4dcf-9360-0ec452bada7e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.024550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1264/2498] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:57:30.025524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7da2-a433-4dcf-9360-0ec452bada7e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.027299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7f5d7da2-a433-4dcf-9360-0ec452bada7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:30.031431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1235/2499] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:30.038975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dc030-5926-4a3d-b8db-6c246bdbbc2f None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.041415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dc030-5926-4a3d-b8db-6c246bdbbc2f None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.041415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dc030-5926-4a3d-b8db-6c246bdbbc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.041606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7da2-a433-4dcf-9360-0ec452bada7e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.044611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6969f36-7176-487b-8dc0-5c961b9d1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.045554 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6969f36-7176-487b-8dc0-5c961b9d1428 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.045778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6969f36-7176-487b-8dc0-5c961b9d1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.046090 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6969f36-7176-487b-8dc0-5c961b9d1428 admin admin] PATH_INFO: `/v3/projects/f10581465073471ca384099a7a5659bb/users/0de9083a05214ef0a22e21f5c6f6d092/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.058422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-076dc030-5926-4a3d-b8db-6c246bdbbc2f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:30.064462 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-076dc030-5926-4a3d-b8db-6c246bdbbc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:30.064577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6969f36-7176-487b-8dc0-5c961b9d1428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10581465073471ca384099a7a5659bb, user_id=0de9083a05214ef0a22e21f5c6f6d092, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.064577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6969f36-7176-487b-8dc0-5c961b9d1428 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.068294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1236/2500] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:30.072497 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dc030-5926-4a3d-b8db-6c246bdbbc2f None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.081473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dc030-5926-4a3d-b8db-6c246bdbbc2f None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.087088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bacdf-3804-40c7-8773-19212c359b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.087730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bacdf-3804-40c7-8773-19212c359b33 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.088372 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bacdf-3804-40c7-8773-19212c359b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.088693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bacdf-3804-40c7-8773-19212c359b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.089415 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bacdf-3804-40c7-8773-19212c359b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:30.089725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bacdf-3804-40c7-8773-19212c359b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.091661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bacdf-3804-40c7-8773-19212c359b33 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.103195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1237/2501] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:57:30.107405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bacdf-3804-40c7-8773-19212c359b33 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.116920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bacdf-3804-40c7-8773-19212c359b33 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.122466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2b38-f256-480f-af04-377b2a54cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.123094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2b38-f256-480f-af04-377b2a54cc24 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.123386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2b38-f256-480f-af04-377b2a54cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.123672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2b38-f256-480f-af04-377b2a54cc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.124398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d2b38-f256-480f-af04-377b2a54cc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.126293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d2b38-f256-480f-af04-377b2a54cc24 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.127892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1265/2502] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:30 2022] PUT /identity/v3/projects/f10581465073471ca384099a7a5659bb/users/0de9083a05214ef0a22e21f5c6f6d092/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:30.131217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6969f36-7176-487b-8dc0-5c961b9d1428 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.192428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6969f36-7176-487b-8dc0-5c961b9d1428 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.197368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1cf13-796e-4985-af83-e7e66ce7fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.198025 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1cf13-796e-4985-af83-e7e66ce7fd2d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.198314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1cf13-796e-4985-af83-e7e66ce7fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.198593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1cf13-796e-4985-af83-e7e66ce7fd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.199343 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1cf13-796e-4985-af83-e7e66ce7fd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.200976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1cf13-796e-4985-af83-e7e66ce7fd2d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.212073 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1266/2503] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:57:30.213565 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1238/2504] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:30 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:30.216660 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1cf13-796e-4985-af83-e7e66ce7fd2d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.217022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2b38-f256-480f-af04-377b2a54cc24 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.226513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1cf13-796e-4985-af83-e7e66ce7fd2d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.230191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:30.279282 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2b38-f256-480f-af04-377b2a54cc24 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.283872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93810-1a6e-428b-83c4-28b4621e11f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.284034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31e90a-b286-46d2-88e9-21e3a62f28cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.284548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93810-1a6e-428b-83c4-28b4621e11f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.284839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93810-1a6e-428b-83c4-28b4621e11f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.284946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31e90a-b286-46d2-88e9-21e3a62f28cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.285120 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93810-1a6e-428b-83c4-28b4621e11f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.285219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31e90a-b286-46d2-88e9-21e3a62f28cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.285402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31e90a-b286-46d2-88e9-21e3a62f28cd admin admin] PATH_INFO: `/v3/projects/f10581465073471ca384099a7a5659bb/users/0de9083a05214ef0a22e21f5c6f6d092/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.285834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93810-1a6e-428b-83c4-28b4621e11f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.287497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31e90a-b286-46d2-88e9-21e3a62f28cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10581465073471ca384099a7a5659bb, user_id=0de9083a05214ef0a22e21f5c6f6d092, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.287789 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93810-1a6e-428b-83c4-28b4621e11f4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.290208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31e90a-b286-46d2-88e9-21e3a62f28cd admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.300661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1267/2505] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:30 2022] PUT /identity/v3/projects/f10581465073471ca384099a7a5659bb/users/0de9083a05214ef0a22e21f5c6f6d092/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:30.311802 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d92d3d-54a9-44d9-a245-8b2c9f8b4b78 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.312096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d92d3d-54a9-44d9-a245-8b2c9f8b4b78 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.312375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d92d3d-54a9-44d9-a245-8b2c9f8b4b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.340378 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b5d92d3d-54a9-44d9-a245-8b2c9f8b4b78 None None] MFA Rules not processed for user `0de9083a05214ef0a22e21f5c6f6d092`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:30.341836 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b5d92d3d-54a9-44d9-a245-8b2c9f8b4b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:30.358775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1239/2506] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:30 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:30.359786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93810-1a6e-428b-83c4-28b4621e11f4 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.370768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93810-1a6e-428b-83c4-28b4621e11f4 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.411529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1268/2507] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:30.422849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d92d3d-54a9-44d9-a245-8b2c9f8b4b78 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.424104 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:30.424274 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b5d92d3d-54a9-44d9-a245-8b2c9f8b4b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:30.431909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9495f-6e42-427a-96a2-b7c8bdd754bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.432588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9495f-6e42-427a-96a2-b7c8bdd754bb admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.436296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9495f-6e42-427a-96a2-b7c8bdd754bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.436296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9495f-6e42-427a-96a2-b7c8bdd754bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.436296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9495f-6e42-427a-96a2-b7c8bdd754bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.436296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9495f-6e42-427a-96a2-b7c8bdd754bb admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.446810 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1240/2508] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:30.450287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9495f-6e42-427a-96a2-b7c8bdd754bb admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.459674 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9495f-6e42-427a-96a2-b7c8bdd754bb admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.464307 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdb7f4-c52f-4ee0-ba3e-60f737d3a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.464954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb7f4-c52f-4ee0-ba3e-60f737d3a1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.465245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb7f4-c52f-4ee0-ba3e-60f737d3a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.465534 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb7f4-c52f-4ee0-ba3e-60f737d3a1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.466551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdb7f4-c52f-4ee0-ba3e-60f737d3a1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.468165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdb7f4-c52f-4ee0-ba3e-60f737d3a1a8 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.478221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1241/2509] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:57:30.482229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdb7f4-c52f-4ee0-ba3e-60f737d3a1a8 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.483944 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d92d3d-54a9-44d9-a245-8b2c9f8b4b78 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.487692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628a063-dda4-446c-9a53-e1a5822020a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.488341 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628a063-dda4-446c-9a53-e1a5822020a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.488628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628a063-dda4-446c-9a53-e1a5822020a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.489440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628a063-dda4-446c-9a53-e1a5822020a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.492062 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdb7f4-c52f-4ee0-ba3e-60f737d3a1a8 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.496905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1b4cb-4c0f-4296-b5d1-3047d9108b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.497758 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1b4cb-4c0f-4296-b5d1-3047d9108b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.498079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1b4cb-4c0f-4296-b5d1-3047d9108b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.498360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1b4cb-4c0f-4296-b5d1-3047d9108b93 admin admin] PATH_INFO: `/v3/projects/f37dd679b7f84cfcb34cb40f29c27929/users/3c45ba47cd004505acdd20a5de54c7b7/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.499061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628a063-dda4-446c-9a53-e1a5822020a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.500642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628a063-dda4-446c-9a53-e1a5822020a1 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.511171 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1269/2510] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:57:30.514364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1b4cb-4c0f-4296-b5d1-3047d9108b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37dd679b7f84cfcb34cb40f29c27929, user_id=3c45ba47cd004505acdd20a5de54c7b7, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.517038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1b4cb-4c0f-4296-b5d1-3047d9108b93 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.618900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1242/2511] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:30 2022] PUT /identity/v3/projects/f37dd679b7f84cfcb34cb40f29c27929/users/3c45ba47cd004505acdd20a5de54c7b7/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:30.630804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59334242-d0fe-483f-a930-195fab6925f7 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.631139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59334242-d0fe-483f-a930-195fab6925f7 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.631376 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59334242-d0fe-483f-a930-195fab6925f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.658286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-59334242-d0fe-483f-a930-195fab6925f7 None None] MFA Rules not processed for user `3c45ba47cd004505acdd20a5de54c7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:30.659431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-59334242-d0fe-483f-a930-195fab6925f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:30.678244 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:30.727947 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1270/2512] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:30.738572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1b4cb-4c0f-4296-b5d1-3047d9108b93 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:30.740927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-64d1b4cb-4c0f-4296-b5d1-3047d9108b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:30.802736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1b4cb-4c0f-4296-b5d1-3047d9108b93 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:30.806405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a5da2-ab1f-42a6-a777-352e3c0f6992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:30.807051 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a5da2-ab1f-42a6-a777-352e3c0f6992 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:30.807376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a5da2-ab1f-42a6-a777-352e3c0f6992 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:30.807663 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a5da2-ab1f-42a6-a777-352e3c0f6992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:30.815970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a5da2-ab1f-42a6-a777-352e3c0f6992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:30.817429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a5da2-ab1f-42a6-a777-352e3c0f6992 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:30.826333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1243/2513] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:31.611230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59334242-d0fe-483f-a930-195fab6925f7 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:31.675561 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59334242-d0fe-483f-a930-195fab6925f7 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:31.680345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:31.681268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:31.681663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:31.681964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] PATH_INFO: `/v3/users/ead7dddbc18b4d8d8886a13b65f1035c` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:31.683159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead7dddbc18b4d8d8886a13b65f1035c)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:31.685113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:31.877305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead7dddbc18b4d8d8886a13b65f1035c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:31.949693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead7dddbc18b4d8d8886a13b65f1035c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:31.962603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead7dddbc18b4d8d8886a13b65f1035c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:31.963252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead7dddbc18b4d8d8886a13b65f1035c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:31.970426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead7dddbc18b4d8d8886a13b65f1035c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:31.976652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1271/2514] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:31 2022] DELETE /identity/v3/users/ead7dddbc18b4d8d8886a13b65f1035c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:31.981126 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff66e25-73be-41c2-894e-57285b10543d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:31.981604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff66e25-73be-41c2-894e-57285b10543d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:31.981734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff66e25-73be-41c2-894e-57285b10543d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:31.998867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2ff66e25-73be-41c2-894e-57285b10543d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:32.000114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2ff66e25-73be-41c2-894e-57285b10543d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:32.058951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1244/2515] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:32.069196 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:32.070620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:32.112756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:32.128169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2e3d-f003-4304-9612-78b8184eafcd admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:32.132370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defc1b-d350-4841-a03a-0bd3a5aa9d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:32.133018 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defc1b-d350-4841-a03a-0bd3a5aa9d16 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:32.133306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defc1b-d350-4841-a03a-0bd3a5aa9d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:32.133586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defc1b-d350-4841-a03a-0bd3a5aa9d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:32.142753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defc1b-d350-4841-a03a-0bd3a5aa9d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:32.144187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defc1b-d350-4841-a03a-0bd3a5aa9d16 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:32.153630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1272/2516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:32.545968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5dc47-68c5-491b-8a43-16a33611ca54 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:32.546355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5dc47-68c5-491b-8a43-16a33611ca54 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:32.550634 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5dc47-68c5-491b-8a43-16a33611ca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:32.569007 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-04d5dc47-68c5-491b-8a43-16a33611ca54 None None] MFA Rules not processed for user `3c45ba47cd004505acdd20a5de54c7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:32.569522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defc1b-d350-4841-a03a-0bd3a5aa9d16 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:32.570257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-04d5dc47-68c5-491b-8a43-16a33611ca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:32.571268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-05defc1b-d350-4841-a03a-0bd3a5aa9d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:32.589032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defc1b-d350-4841-a03a-0bd3a5aa9d16 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:32.595153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:32.596210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:32.597056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:32.597513 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] PATH_INFO: `/v3/projects/10a5764e46ed42488ebc71d54855fb13` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:32.599489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a5764e46ed42488ebc71d54855fb13)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:32.602389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:32.635245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1245/2517] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:32.745897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a5764e46ed42488ebc71d54855fb13', 'request_id': 'req-0d44f88e-08ea-4950-a0af-386b91c7e3b8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:32.799434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a5764e46ed42488ebc71d54855fb13', 'request_id': 'req-0d44f88e-08ea-4950-a0af-386b91c7e3b8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:32.806323 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a5764e46ed42488ebc71d54855fb13', 'request_id': 'req-0d44f88e-08ea-4950-a0af-386b91c7e3b8'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:32.817180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] The token cache is being invalidate because project 10a5764e46ed42488ebc71d54855fb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:32.817453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:32.818141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:32.819693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1273/2518] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:32 2022] DELETE /identity/v3/projects/10a5764e46ed42488ebc71d54855fb13 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:32.824020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5dc47-68c5-491b-8a43-16a33611ca54 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:32.836186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5dc47-68c5-491b-8a43-16a33611ca54 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:32.839873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:32.894246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:32.895610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:32.895899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:32.896181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] PATH_INFO: `/v3/users/0de9083a05214ef0a22e21f5c6f6d092` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:32.897402 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de9083a05214ef0a22e21f5c6f6d092)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:32.899444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:33.105208 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de9083a05214ef0a22e21f5c6f6d092'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:33.166574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de9083a05214ef0a22e21f5c6f6d092'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:33.166574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de9083a05214ef0a22e21f5c6f6d092'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:33.179982 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de9083a05214ef0a22e21f5c6f6d092'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:33.180875 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-04e5b505-6c2c-4553-b0b0-7d7daa3bc9cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de9083a05214ef0a22e21f5c6f6d092'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:33.195325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1246/2519] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:32 2022] DELETE /identity/v3/users/0de9083a05214ef0a22e21f5c6f6d092 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:33.683446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:33.684981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:33.700093 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44f88e-08ea-4950-a0af-386b91c7e3b8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:33.770225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:33.770225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:33.770225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:33.770225 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] PATH_INFO: `/v3/projects/f10581465073471ca384099a7a5659bb` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:33.771055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10581465073471ca384099a7a5659bb)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:33.771055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:33.898895 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10581465073471ca384099a7a5659bb', 'request_id': 'req-21cab95a-fa17-4240-bbe8-dda14305acde'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:33.984839 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10581465073471ca384099a7a5659bb', 'request_id': 'req-21cab95a-fa17-4240-bbe8-dda14305acde'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:33.993850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10581465073471ca384099a7a5659bb', 'request_id': 'req-21cab95a-fa17-4240-bbe8-dda14305acde'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:33.998693 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:34.005829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] The token cache is being invalidate because project f10581465073471ca384099a7a5659bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:34.006156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:34.006902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21cab95a-fa17-4240-bbe8-dda14305acde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:34.008459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1274/2520] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:33 2022] DELETE /identity/v3/projects/f10581465073471ca384099a7a5659bb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:34.013385 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6712-a5aa-417d-affc-8ccd12b504fb None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.013678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6712-a5aa-417d-affc-8ccd12b504fb None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.013973 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6712-a5aa-417d-affc-8ccd12b504fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.031015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c13c6712-a5aa-417d-affc-8ccd12b504fb None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:34.032200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c13c6712-a5aa-417d-affc-8ccd12b504fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:34.091047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1247/2521] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:34.099597 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd05-e67e-4d65-8e34-29612ec014f2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.099921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd05-e67e-4d65-8e34-29612ec014f2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.100202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd05-e67e-4d65-8e34-29612ec014f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.118808 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-cec6bd05-e67e-4d65-8e34-29612ec014f2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:34.120010 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cec6bd05-e67e-4d65-8e34-29612ec014f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:34.128039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1275/2522] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:34.132241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6712-a5aa-417d-affc-8ccd12b504fb None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:34.142168 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6712-a5aa-417d-affc-8ccd12b504fb None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:34.147231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c8006-23eb-4495-a961-e8a52a126a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:34.147884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c8006-23eb-4495-a961-e8a52a126a33 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.148175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c8006-23eb-4495-a961-e8a52a126a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.148460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c8006-23eb-4495-a961-e8a52a126a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.149194 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c8006-23eb-4495-a961-e8a52a126a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:34.149511 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c8006-23eb-4495-a961-e8a52a126a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:34.151171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c8006-23eb-4495-a961-e8a52a126a33 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:34.163595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1248/2523] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:57:34.167751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6bd05-e67e-4d65-8e34-29612ec014f2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:34.177126 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6bd05-e67e-4d65-8e34-29612ec014f2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:34.181865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59517782-6613-4e63-9d9c-11b88f620232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:34.182550 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59517782-6613-4e63-9d9c-11b88f620232 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.182841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59517782-6613-4e63-9d9c-11b88f620232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.183123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59517782-6613-4e63-9d9c-11b88f620232 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.183817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59517782-6613-4e63-9d9c-11b88f620232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:34.185744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59517782-6613-4e63-9d9c-11b88f620232 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:34.302651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1276/2524] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:34 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:34.306413 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c8006-23eb-4495-a961-e8a52a126a33 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:34.317153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c8006-23eb-4495-a961-e8a52a126a33 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:34.340672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:34.396384 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa3d20-eb6c-44ec-a8d6-77222de1da62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:34.397588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3d20-eb6c-44ec-a8d6-77222de1da62 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.397876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3d20-eb6c-44ec-a8d6-77222de1da62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.398212 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3d20-eb6c-44ec-a8d6-77222de1da62 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.399012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa3d20-eb6c-44ec-a8d6-77222de1da62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:34.400991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa3d20-eb6c-44ec-a8d6-77222de1da62 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:34.517081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1249/2525] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:34 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:34.521070 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59517782-6613-4e63-9d9c-11b88f620232 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:34.532599 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59517782-6613-4e63-9d9c-11b88f620232 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:34.537613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b950b-7004-466c-8707-f02ff5da34c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:34.538391 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b950b-7004-466c-8707-f02ff5da34c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.538694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b950b-7004-466c-8707-f02ff5da34c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.538960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b950b-7004-466c-8707-f02ff5da34c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.539699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b950b-7004-466c-8707-f02ff5da34c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:34.541354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b950b-7004-466c-8707-f02ff5da34c3 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:34.553453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1277/2526] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:34.557501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa3d20-eb6c-44ec-a8d6-77222de1da62 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:34.567657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa3d20-eb6c-44ec-a8d6-77222de1da62 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:34.572831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82094998-75ea-4ff8-8a3c-2b3b7616b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:34.573489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82094998-75ea-4ff8-8a3c-2b3b7616b45b admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.573779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82094998-75ea-4ff8-8a3c-2b3b7616b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.574097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82094998-75ea-4ff8-8a3c-2b3b7616b45b admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.574830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82094998-75ea-4ff8-8a3c-2b3b7616b45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:34.576423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82094998-75ea-4ff8-8a3c-2b3b7616b45b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:34.587584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1250/2527] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:34.591813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b950b-7004-466c-8707-f02ff5da34c3 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:34.601877 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b950b-7004-466c-8707-f02ff5da34c3 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:34.606572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43dbc0-33d7-4490-9c2b-4167185ffb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:34.607439 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43dbc0-33d7-4490-9c2b-4167185ffb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.607726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43dbc0-33d7-4490-9c2b-4167185ffb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.608003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43dbc0-33d7-4490-9c2b-4167185ffb50 admin admin] PATH_INFO: `/v3/projects/f2ee84f4e3b046ed8ab452c58df26540/users/43797a7f2ebd4705ad8bff965f2d328b/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.622903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43dbc0-33d7-4490-9c2b-4167185ffb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ee84f4e3b046ed8ab452c58df26540, user_id=43797a7f2ebd4705ad8bff965f2d328b, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:34.625640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43dbc0-33d7-4490-9c2b-4167185ffb50 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:34.710124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1278/2528] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:34 2022] PUT /identity/v3/projects/f2ee84f4e3b046ed8ab452c58df26540/users/43797a7f2ebd4705ad8bff965f2d328b/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:34.728871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c79add-ef9a-4635-9c9a-1708a8d61890 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.736598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c79add-ef9a-4635-9c9a-1708a8d61890 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.736598 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c79add-ef9a-4635-9c9a-1708a8d61890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.758099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c7c79add-ef9a-4635-9c9a-1708a8d61890 None None] MFA Rules not processed for user `43797a7f2ebd4705ad8bff965f2d328b`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:34.759468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c7c79add-ef9a-4635-9c9a-1708a8d61890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:34.834196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1251/2529] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:34.837974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43dbc0-33d7-4490-9c2b-4167185ffb50 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:34.907492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43dbc0-33d7-4490-9c2b-4167185ffb50 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:34.912741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85930b1-80a5-4b8e-b88c-4ae6d1915b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:34.913453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85930b1-80a5-4b8e-b88c-4ae6d1915b2e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.913807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85930b1-80a5-4b8e-b88c-4ae6d1915b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.914184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85930b1-80a5-4b8e-b88c-4ae6d1915b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.914954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85930b1-80a5-4b8e-b88c-4ae6d1915b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:34.916952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85930b1-80a5-4b8e-b88c-4ae6d1915b2e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:34.992197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1279/2530] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:34 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:34.996228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c79add-ef9a-4635-9c9a-1708a8d61890 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:35.007582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c79add-ef9a-4635-9c9a-1708a8d61890 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:35.077895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e11b9b-743c-4562-9741-fa0df889d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:35.078751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e11b9b-743c-4562-9741-fa0df889d1fa admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:35.079036 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e11b9b-743c-4562-9741-fa0df889d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:35.079349 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e11b9b-743c-4562-9741-fa0df889d1fa admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:35.080053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e11b9b-743c-4562-9741-fa0df889d1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:35.082011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e11b9b-743c-4562-9741-fa0df889d1fa admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:35.160880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1252/2531] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:34 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:35.165558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85930b1-80a5-4b8e-b88c-4ae6d1915b2e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:35.176546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85930b1-80a5-4b8e-b88c-4ae6d1915b2e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:35.181791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2ccc-84c8-4e4d-b4c3-7c4ac3d01847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:35.184419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2ccc-84c8-4e4d-b4c3-7c4ac3d01847 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:35.184419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2ccc-84c8-4e4d-b4c3-7c4ac3d01847 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:35.184419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2ccc-84c8-4e4d-b4c3-7c4ac3d01847 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:35.184419 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b2ccc-84c8-4e4d-b4c3-7c4ac3d01847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:35.185504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b2ccc-84c8-4e4d-b4c3-7c4ac3d01847 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:35.196248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1280/2532] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:35.200394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e11b9b-743c-4562-9741-fa0df889d1fa admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:35.210813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e11b9b-743c-4562-9741-fa0df889d1fa admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:35.215443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b985b4-ef84-4b29-88bc-0df9d32169c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:35.216608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b985b4-ef84-4b29-88bc-0df9d32169c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:35.216913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b985b4-ef84-4b29-88bc-0df9d32169c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:35.217196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b985b4-ef84-4b29-88bc-0df9d32169c6 admin admin] PATH_INFO: `/v3/projects/ac250dbdb5db4cd6999daed09136faf3/users/4b904ba584f64ee1a99cd3e2d479b603/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:35.226552 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:35.233008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b985b4-ef84-4b29-88bc-0df9d32169c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac250dbdb5db4cd6999daed09136faf3, user_id=4b904ba584f64ee1a99cd3e2d479b603, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:35.235713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b985b4-ef84-4b29-88bc-0df9d32169c6 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:35.311434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1253/2533] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:35 2022] PUT /identity/v3/projects/ac250dbdb5db4cd6999daed09136faf3/users/4b904ba584f64ee1a99cd3e2d479b603/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:35.315482 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2ccc-84c8-4e4d-b4c3-7c4ac3d01847 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:35.325313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2ccc-84c8-4e4d-b4c3-7c4ac3d01847 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:35.391074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2863e-12b2-46a3-b6be-d94d0597477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:35.391760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2863e-12b2-46a3-b6be-d94d0597477c admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:35.392048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2863e-12b2-46a3-b6be-d94d0597477c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:35.392330 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2863e-12b2-46a3-b6be-d94d0597477c admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:35.393096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2863e-12b2-46a3-b6be-d94d0597477c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:35.394794 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2863e-12b2-46a3-b6be-d94d0597477c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:35.400591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:35.406130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1281/2534] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:35.414287 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b985b4-ef84-4b29-88bc-0df9d32169c6 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:35.435843 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b985b4-ef84-4b29-88bc-0df9d32169c6 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:35.441584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a60b02-a69c-4001-87ed-8281488d9a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:35.442742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a60b02-a69c-4001-87ed-8281488d9a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:35.443189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a60b02-a69c-4001-87ed-8281488d9a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:35.443627 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a60b02-a69c-4001-87ed-8281488d9a9d admin admin] PATH_INFO: `/v3/projects/ac250dbdb5db4cd6999daed09136faf3/users/4b904ba584f64ee1a99cd3e2d479b603/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:35.445849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a60b02-a69c-4001-87ed-8281488d9a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac250dbdb5db4cd6999daed09136faf3, user_id=4b904ba584f64ee1a99cd3e2d479b603, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:35.448717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a60b02-a69c-4001-87ed-8281488d9a9d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:35.461053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1254/2535] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:35 2022] PUT /identity/v3/projects/ac250dbdb5db4cd6999daed09136faf3/users/4b904ba584f64ee1a99cd3e2d479b603/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:35.477324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6c926-0edb-497f-b267-2b19ed40a7e8 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:35.477324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6c926-0edb-497f-b267-2b19ed40a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:35.477324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6c926-0edb-497f-b267-2b19ed40a7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:35.507515 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-dcd6c926-0edb-497f-b267-2b19ed40a7e8 None None] MFA Rules not processed for user `4b904ba584f64ee1a99cd3e2d479b603`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:35.509542 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-dcd6c926-0edb-497f-b267-2b19ed40a7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:35.588826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1282/2536] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:35.603455 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a60b02-a69c-4001-87ed-8281488d9a9d admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:35.605709 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d8a60b02-a69c-4001-87ed-8281488d9a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:35.665574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a60b02-a69c-4001-87ed-8281488d9a9d admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:35.669302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f825d-6c6d-495f-aa70-4f374193c068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:35.669970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f825d-6c6d-495f-aa70-4f374193c068 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:35.670264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f825d-6c6d-495f-aa70-4f374193c068 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:35.670539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f825d-6c6d-495f-aa70-4f374193c068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:35.679926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f825d-6c6d-495f-aa70-4f374193c068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:35.681371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f825d-6c6d-495f-aa70-4f374193c068 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:35.692600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1255/2537] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:36.743664 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6c926-0edb-497f-b267-2b19ed40a7e8 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:36.753107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6c926-0edb-497f-b267-2b19ed40a7e8 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:36.758202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c42487-007b-41c8-a4d2-21b480d5224a tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b904ba584f64ee1a99cd3e2d479b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac250dbdb5db4cd6999daed09136faf3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:36.758866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c42487-007b-41c8-a4d2-21b480d5224a tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:36.759570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c42487-007b-41c8-a4d2-21b480d5224a tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:36.759570 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c42487-007b-41c8-a4d2-21b480d5224a tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:36.760518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c42487-007b-41c8-a4d2-21b480d5224a tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:36.760997 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c42487-007b-41c8-a4d2-21b480d5224a tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:36.762653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c42487-007b-41c8-a4d2-21b480d5224a tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:36.780272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f825d-6c6d-495f-aa70-4f374193c068 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:36.782116 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1283/2538] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:57:36.790011 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f825d-6c6d-495f-aa70-4f374193c068 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:36.794637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3ee1f-9d02-4004-82be-1444094f1c8b tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b904ba584f64ee1a99cd3e2d479b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac250dbdb5db4cd6999daed09136faf3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:36.795281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3ee1f-9d02-4004-82be-1444094f1c8b tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:36.795568 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3ee1f-9d02-4004-82be-1444094f1c8b tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:36.795857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3ee1f-9d02-4004-82be-1444094f1c8b tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:36.796540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3ee1f-9d02-4004-82be-1444094f1c8b tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:36.798524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3ee1f-9d02-4004-82be-1444094f1c8b tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:36.880482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1256/2539] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:36 2022] POST /identity/v3/projects => generated 355 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:36.881679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c42487-007b-41c8-a4d2-21b480d5224a tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:36.892026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c42487-007b-41c8-a4d2-21b480d5224a tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:36.951284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b904ba584f64ee1a99cd3e2d479b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac250dbdb5db4cd6999daed09136faf3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:36.951955 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:36.952262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:36.952552 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:36.953291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:36.953610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:36.955267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:36.967489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1284/2540] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:57:37.011153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3ee1f-9d02-4004-82be-1444094f1c8b tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:37.021918 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3ee1f-9d02-4004-82be-1444094f1c8b tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:37.026786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b904ba584f64ee1a99cd3e2d479b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac250dbdb5db4cd6999daed09136faf3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:37.027650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:37.027938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:37.028217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] PATH_INFO: `/v3/projects/1da7c968a0764c63bd383da67685354b` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:37.029403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1da7c968a0764c63bd383da67685354b)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:37.033835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:37.176378 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da7c968a0764c63bd383da67685354b', 'request_id': 'req-36944869-b950-4529-af83-8df3ab9eceef'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:37.180856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da7c968a0764c63bd383da67685354b', 'request_id': 'req-36944869-b950-4529-af83-8df3ab9eceef'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:37.247652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da7c968a0764c63bd383da67685354b', 'request_id': 'req-36944869-b950-4529-af83-8df3ab9eceef'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:37.265046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] The token cache is being invalidate because project 1da7c968a0764c63bd383da67685354b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:37.265388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:37.267524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-36944869-b950-4529-af83-8df3ab9eceef tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:37.269726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1257/2541] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:37 2022] DELETE /identity/v3/projects/1da7c968a0764c63bd383da67685354b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:38.028925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:38.030739 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:38.098739 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05322e0-2b97-4a8e-a760-fec6b690a701 tempest-VolumeQuotaClassesTest-286574306 tempest-VolumeQuotaClassesTest-286574306-project-admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:38.108383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:38.156777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:38.157852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:38.158188 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:38.158474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] PATH_INFO: `/v3/users/43797a7f2ebd4705ad8bff965f2d328b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:38.159751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43797a7f2ebd4705ad8bff965f2d328b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:38.161737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:38.353074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43797a7f2ebd4705ad8bff965f2d328b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:38.445255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43797a7f2ebd4705ad8bff965f2d328b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:38.458592 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43797a7f2ebd4705ad8bff965f2d328b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:38.459297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43797a7f2ebd4705ad8bff965f2d328b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:38.466878 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43797a7f2ebd4705ad8bff965f2d328b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:38.472954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1285/2542] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:38 2022] DELETE /identity/v3/users/43797a7f2ebd4705ad8bff965f2d328b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:38.478296 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f90630-2a23-4e5e-ac4c-82e88aadc21b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:38.478778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f90630-2a23-4e5e-ac4c-82e88aadc21b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:38.479004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f90630-2a23-4e5e-ac4c-82e88aadc21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:38.497116 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-76f90630-2a23-4e5e-ac4c-82e88aadc21b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:38.498342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-76f90630-2a23-4e5e-ac4c-82e88aadc21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:38.530185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:38.558489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1258/2543] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:38.571357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:38.571357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:38.646919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807bfbb-0333-4ceb-a73f-97bbff01784e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:38.651336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263ac25-63d6-44d3-9721-0416e79439ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:38.652042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263ac25-63d6-44d3-9721-0416e79439ea service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:38.652332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263ac25-63d6-44d3-9721-0416e79439ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:38.652614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263ac25-63d6-44d3-9721-0416e79439ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:38.662246 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263ac25-63d6-44d3-9721-0416e79439ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:38.664332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263ac25-63d6-44d3-9721-0416e79439ea service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:38.674838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1286/2544] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:39.076791 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f90630-2a23-4e5e-ac4c-82e88aadc21b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:39.078572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-76f90630-2a23-4e5e-ac4c-82e88aadc21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:39.093488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f90630-2a23-4e5e-ac4c-82e88aadc21b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:39.099935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:39.107507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:39.107507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:39.107507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] PATH_INFO: `/v3/projects/f2ee84f4e3b046ed8ab452c58df26540` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:39.107507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ee84f4e3b046ed8ab452c58df26540)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:39.107507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:39.225696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ee84f4e3b046ed8ab452c58df26540', 'request_id': 'req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.232103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ee84f4e3b046ed8ab452c58df26540', 'request_id': 'req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.298369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ee84f4e3b046ed8ab452c58df26540', 'request_id': 'req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.309905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] The token cache is being invalidate because project f2ee84f4e3b046ed8ab452c58df26540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:39.310182 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.310798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.312398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1259/2545] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:39 2022] DELETE /identity/v3/projects/f2ee84f4e3b046ed8ab452c58df26540 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:39.316393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263ac25-63d6-44d3-9721-0416e79439ea service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:39.326682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263ac25-63d6-44d3-9721-0416e79439ea service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:39.361120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:39.387421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:39.388321 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:39.388606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:39.388887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] PATH_INFO: `/v3/users/4b904ba584f64ee1a99cd3e2d479b603` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:39.390112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b904ba584f64ee1a99cd3e2d479b603)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:39.392097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:39.719727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b904ba584f64ee1a99cd3e2d479b603'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.795510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b904ba584f64ee1a99cd3e2d479b603'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.814055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b904ba584f64ee1a99cd3e2d479b603'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.814796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b904ba584f64ee1a99cd3e2d479b603'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.822652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0495bb20-14f8-43f1-8a33-b237616af8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b904ba584f64ee1a99cd3e2d479b603'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:39.829603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1287/2546] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:39 2022] DELETE /identity/v3/users/4b904ba584f64ee1a99cd3e2d479b603 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:40.401865 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:40.403376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:40.418039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1bbe-2c8a-4a44-ae82-f51f0246ead2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:40.489599 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:40.490507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:40.490821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:40.491101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] PATH_INFO: `/v3/projects/ac250dbdb5db4cd6999daed09136faf3` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:40.492286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac250dbdb5db4cd6999daed09136faf3)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:40.494229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:40.729680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac250dbdb5db4cd6999daed09136faf3', 'request_id': 'req-b6b3336d-ccef-4040-9c58-b396e63dd39d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:40.735964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac250dbdb5db4cd6999daed09136faf3', 'request_id': 'req-b6b3336d-ccef-4040-9c58-b396e63dd39d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:40.801111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac250dbdb5db4cd6999daed09136faf3', 'request_id': 'req-b6b3336d-ccef-4040-9c58-b396e63dd39d'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:40.804151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:40.814258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] The token cache is being invalidate because project ac250dbdb5db4cd6999daed09136faf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:40.814607 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:40.815272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b6b3336d-ccef-4040-9c58-b396e63dd39d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:40.816872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1260/2547] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:40 2022] DELETE /identity/v3/projects/ac250dbdb5db4cd6999daed09136faf3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:40.823008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c174-a31a-41fe-bcd4-eb1618a97873 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:40.828307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c174-a31a-41fe-bcd4-eb1618a97873 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:40.828307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c174-a31a-41fe-bcd4-eb1618a97873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:40.844040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7329c174-a31a-41fe-bcd4-eb1618a97873 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:40.848400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7329c174-a31a-41fe-bcd4-eb1618a97873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:40.938810 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1288/2548] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:40.947115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b2144-7d9e-422c-8924-4bac056815ba None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:40.948179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b2144-7d9e-422c-8924-4bac056815ba None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:40.948572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b2144-7d9e-422c-8924-4bac056815ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:40.971429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-636b2144-7d9e-422c-8924-4bac056815ba None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:40.972687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-636b2144-7d9e-422c-8924-4bac056815ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:40.981741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1261/2549] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:40.986043 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329c174-a31a-41fe-bcd4-eb1618a97873 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:40.997213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329c174-a31a-41fe-bcd4-eb1618a97873 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:41.002109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0fc4d-219a-4710-9644-57cb8640528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:41.002903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0fc4d-219a-4710-9644-57cb8640528a admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.003292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0fc4d-219a-4710-9644-57cb8640528a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.003643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0fc4d-219a-4710-9644-57cb8640528a admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.004460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0fc4d-219a-4710-9644-57cb8640528a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:41.004851 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0fc4d-219a-4710-9644-57cb8640528a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:41.007220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0fc4d-219a-4710-9644-57cb8640528a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:41.019897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1289/2550] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:57:41.024523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b2144-7d9e-422c-8924-4bac056815ba None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:41.036668 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b2144-7d9e-422c-8924-4bac056815ba None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:41.042476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d3ccb-b43e-43b6-9246-83a9485bf699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:41.043281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d3ccb-b43e-43b6-9246-83a9485bf699 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.043640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d3ccb-b43e-43b6-9246-83a9485bf699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.044157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d3ccb-b43e-43b6-9246-83a9485bf699 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.044886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d3ccb-b43e-43b6-9246-83a9485bf699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:41.046920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d3ccb-b43e-43b6-9246-83a9485bf699 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:41.141062 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1262/2551] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:41 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:41.145083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0fc4d-219a-4710-9644-57cb8640528a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:41.155346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0fc4d-219a-4710-9644-57cb8640528a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:41.222317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:41.241418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525729-fea1-4180-82b2-c9cb2ff29545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:41.242147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525729-fea1-4180-82b2-c9cb2ff29545 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.242562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525729-fea1-4180-82b2-c9cb2ff29545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.242845 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525729-fea1-4180-82b2-c9cb2ff29545 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.243552 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48525729-fea1-4180-82b2-c9cb2ff29545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:41.245584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48525729-fea1-4180-82b2-c9cb2ff29545 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:41.322217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1290/2552] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:41 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:41.326121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d3ccb-b43e-43b6-9246-83a9485bf699 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:41.336584 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d3ccb-b43e-43b6-9246-83a9485bf699 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:41.342224 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017028b-0786-44d1-ab12-120cb195c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:41.342896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017028b-0786-44d1-ab12-120cb195c622 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.348473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017028b-0786-44d1-ab12-120cb195c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.348473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017028b-0786-44d1-ab12-120cb195c622 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.348473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017028b-0786-44d1-ab12-120cb195c622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:41.348473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017028b-0786-44d1-ab12-120cb195c622 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:41.362489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1263/2553] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:41.364095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525729-fea1-4180-82b2-c9cb2ff29545 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:41.376402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525729-fea1-4180-82b2-c9cb2ff29545 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:41.381886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254112d-9ce8-46de-b305-61c77156e1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:41.383385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254112d-9ce8-46de-b305-61c77156e1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.383698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254112d-9ce8-46de-b305-61c77156e1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.384047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254112d-9ce8-46de-b305-61c77156e1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.384773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254112d-9ce8-46de-b305-61c77156e1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:41.386742 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254112d-9ce8-46de-b305-61c77156e1f9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:41.404627 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1291/2554] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:41.405188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017028b-0786-44d1-ab12-120cb195c622 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:41.418144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017028b-0786-44d1-ab12-120cb195c622 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:41.423392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52011b-200f-4408-b260-a0de4e41f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:41.429096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52011b-200f-4408-b260-a0de4e41f685 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.429096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52011b-200f-4408-b260-a0de4e41f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.429096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52011b-200f-4408-b260-a0de4e41f685 admin admin] PATH_INFO: `/v3/projects/31d1a5a385814ec08cc988f065465cba/users/5bfee7b89ba942bc91ebd8fff6e7c24b/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.446330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52011b-200f-4408-b260-a0de4e41f685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d1a5a385814ec08cc988f065465cba, user_id=5bfee7b89ba942bc91ebd8fff6e7c24b, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:41.452023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52011b-200f-4408-b260-a0de4e41f685 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:41.562020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1264/2555] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:41 2022] PUT /identity/v3/projects/31d1a5a385814ec08cc988f065465cba/users/5bfee7b89ba942bc91ebd8fff6e7c24b/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:41.573210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c5fd8-1d4f-47a7-a7f7-71b8e3950924 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.573545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c5fd8-1d4f-47a7-a7f7-71b8e3950924 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.573970 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c5fd8-1d4f-47a7-a7f7-71b8e3950924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.617430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-147c5fd8-1d4f-47a7-a7f7-71b8e3950924 None None] MFA Rules not processed for user `5bfee7b89ba942bc91ebd8fff6e7c24b`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:41.621351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-147c5fd8-1d4f-47a7-a7f7-71b8e3950924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:41.724547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1292/2556] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:41.730100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52011b-200f-4408-b260-a0de4e41f685 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:41.804439 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52011b-200f-4408-b260-a0de4e41f685 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:41.809279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588c85c-0a01-454c-b5a1-aef99a6f30b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:41.809970 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588c85c-0a01-454c-b5a1-aef99a6f30b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.810257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588c85c-0a01-454c-b5a1-aef99a6f30b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.810535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588c85c-0a01-454c-b5a1-aef99a6f30b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.811386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588c85c-0a01-454c-b5a1-aef99a6f30b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:41.813311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588c85c-0a01-454c-b5a1-aef99a6f30b1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.051716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1265/2557] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:41 2022] POST /identity/v3/projects => generated 389 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:42.053304 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c5fd8-1d4f-47a7-a7f7-71b8e3950924 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.065005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c5fd8-1d4f-47a7-a7f7-71b8e3950924 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.134413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c26a4-5df2-4007-9204-a48ce7d111e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.135101 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c26a4-5df2-4007-9204-a48ce7d111e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.135395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c26a4-5df2-4007-9204-a48ce7d111e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.135679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c26a4-5df2-4007-9204-a48ce7d111e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.136380 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c26a4-5df2-4007-9204-a48ce7d111e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.138370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c26a4-5df2-4007-9204-a48ce7d111e9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.249634 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1293/2558] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:42 2022] POST /identity/v3/users => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:42.253632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588c85c-0a01-454c-b5a1-aef99a6f30b1 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.287700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588c85c-0a01-454c-b5a1-aef99a6f30b1 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.313556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be7330-ac59-41e1-9aa7-03b4d90f5263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.319933 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be7330-ac59-41e1-9aa7-03b4d90f5263 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.321705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be7330-ac59-41e1-9aa7-03b4d90f5263 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.321705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be7330-ac59-41e1-9aa7-03b4d90f5263 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.321705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be7330-ac59-41e1-9aa7-03b4d90f5263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.325989 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be7330-ac59-41e1-9aa7-03b4d90f5263 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.350352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1266/2559] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:42.355254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c26a4-5df2-4007-9204-a48ce7d111e9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.370181 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c26a4-5df2-4007-9204-a48ce7d111e9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.398160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd9ba8-dcea-435c-a76f-0c12a98a2331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.398160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd9ba8-dcea-435c-a76f-0c12a98a2331 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.398160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd9ba8-dcea-435c-a76f-0c12a98a2331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.398160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd9ba8-dcea-435c-a76f-0c12a98a2331 admin admin] PATH_INFO: `/v3/projects/436562379e1244138d4812d848048032/users/29c7e640b9094d34b24be6d6e2df1eb8/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.404042 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd9ba8-dcea-435c-a76f-0c12a98a2331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436562379e1244138d4812d848048032, user_id=29c7e640b9094d34b24be6d6e2df1eb8, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.406897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd9ba8-dcea-435c-a76f-0c12a98a2331 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.486267 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1294/2560] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:42 2022] PUT /identity/v3/projects/436562379e1244138d4812d848048032/users/29c7e640b9094d34b24be6d6e2df1eb8/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:42.490465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be7330-ac59-41e1-9aa7-03b4d90f5263 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.501927 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be7330-ac59-41e1-9aa7-03b4d90f5263 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.580082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed65c0f-b853-42d7-a7a6-f17f1d8fa4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.580760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed65c0f-b853-42d7-a7a6-f17f1d8fa4db admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.581047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed65c0f-b853-42d7-a7a6-f17f1d8fa4db admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.581327 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed65c0f-b853-42d7-a7a6-f17f1d8fa4db admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.582093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed65c0f-b853-42d7-a7a6-f17f1d8fa4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.584472 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed65c0f-b853-42d7-a7a6-f17f1d8fa4db admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.586988 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:42.595496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1267/2561] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:42.599892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd9ba8-dcea-435c-a76f-0c12a98a2331 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.611264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd9ba8-dcea-435c-a76f-0c12a98a2331 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.616628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d456c7e-a408-47cb-b12e-0d76c5ff002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.617465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d456c7e-a408-47cb-b12e-0d76c5ff002f admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.630185 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d456c7e-a408-47cb-b12e-0d76c5ff002f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.634372 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d456c7e-a408-47cb-b12e-0d76c5ff002f admin admin] PATH_INFO: `/v3/projects/436562379e1244138d4812d848048032/users/29c7e640b9094d34b24be6d6e2df1eb8/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.635708 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d456c7e-a408-47cb-b12e-0d76c5ff002f admin admin] RBAC: Authorizing `identity:create_grant(project_id=436562379e1244138d4812d848048032, user_id=29c7e640b9094d34b24be6d6e2df1eb8, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.638454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d456c7e-a408-47cb-b12e-0d76c5ff002f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.651932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1295/2562] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:42 2022] PUT /identity/v3/projects/436562379e1244138d4812d848048032/users/29c7e640b9094d34b24be6d6e2df1eb8/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:42.662060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a3c7f-5055-473c-abca-cf796ed79808 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.662355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a3c7f-5055-473c-abca-cf796ed79808 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.663148 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a3c7f-5055-473c-abca-cf796ed79808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.691048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4e0a3c7f-5055-473c-abca-cf796ed79808 None None] MFA Rules not processed for user `29c7e640b9094d34b24be6d6e2df1eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:42.692256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4e0a3c7f-5055-473c-abca-cf796ed79808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:42.762890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1268/2563] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:42.781442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d456c7e-a408-47cb-b12e-0d76c5ff002f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.785950 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5d456c7e-a408-47cb-b12e-0d76c5ff002f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:42.789242 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:42.842932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d456c7e-a408-47cb-b12e-0d76c5ff002f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.846929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80c2e8-d831-415b-9efe-6259bbef5b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.847568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80c2e8-d831-415b-9efe-6259bbef5b8c service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.847852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80c2e8-d831-415b-9efe-6259bbef5b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.848127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80c2e8-d831-415b-9efe-6259bbef5b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.858703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80c2e8-d831-415b-9efe-6259bbef5b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.860396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80c2e8-d831-415b-9efe-6259bbef5b8c service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.870390 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1296/2564] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:42.920886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a3c7f-5055-473c-abca-cf796ed79808 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.921237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4e0a3c7f-5055-473c-abca-cf796ed79808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:42.933616 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a3c7f-5055-473c-abca-cf796ed79808 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.937398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b979392-ee4c-4a2b-bf98-58a6a298e3e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.938291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b979392-ee4c-4a2b-bf98-58a6a298e3e0 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.938617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b979392-ee4c-4a2b-bf98-58a6a298e3e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.938894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b979392-ee4c-4a2b-bf98-58a6a298e3e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.995362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b979392-ee4c-4a2b-bf98-58a6a298e3e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.996808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b979392-ee4c-4a2b-bf98-58a6a298e3e0 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:43.005727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1269/2565] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:48.097008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80c2e8-d831-415b-9efe-6259bbef5b8c service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:48.189730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80c2e8-d831-415b-9efe-6259bbef5b8c service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:48.195111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:48.196782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:48.197069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:48.197350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] PATH_INFO: `/v3/users/5bfee7b89ba942bc91ebd8fff6e7c24b` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:48.198741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfee7b89ba942bc91ebd8fff6e7c24b)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:48.200671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:48.399050 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfee7b89ba942bc91ebd8fff6e7c24b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:48.499642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfee7b89ba942bc91ebd8fff6e7c24b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:48.517298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfee7b89ba942bc91ebd8fff6e7c24b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:48.518123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfee7b89ba942bc91ebd8fff6e7c24b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:48.534337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfee7b89ba942bc91ebd8fff6e7c24b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:48.543924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1297/2566] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:48 2022] DELETE /identity/v3/users/5bfee7b89ba942bc91ebd8fff6e7c24b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:48.548419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd69ff9-604b-452c-a5c3-28ab9feb798b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:48.548937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd69ff9-604b-452c-a5c3-28ab9feb798b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:48.549049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd69ff9-604b-452c-a5c3-28ab9feb798b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:48.576797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1dd69ff9-604b-452c-a5c3-28ab9feb798b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:48.578082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1dd69ff9-604b-452c-a5c3-28ab9feb798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:48.654929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:48.656395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:48.662438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1270/2567] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:48.675101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd69ff9-604b-452c-a5c3-28ab9feb798b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:48.680572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1dd69ff9-604b-452c-a5c3-28ab9feb798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:48.691370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:48.708695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:48.729314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a59ee0-451a-4e3e-9740-edafdd9c51f0 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:48.738002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:48.738002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:48.738002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:48.738002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:48.739096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:48.751021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd69ff9-604b-452c-a5c3-28ab9feb798b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:48.753001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:48.755208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:48.755374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf44fb-2fe6-495c-9c73-553922c7c01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:48.755963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf44fb-2fe6-495c-9c73-553922c7c01a service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:48.756309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf44fb-2fe6-495c-9c73-553922c7c01a service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:48.756591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf44fb-2fe6-495c-9c73-553922c7c01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:48.767815 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf44fb-2fe6-495c-9c73-553922c7c01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:48.769271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf44fb-2fe6-495c-9c73-553922c7c01a service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:48.770525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1298/2568] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:48.780033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1271/2569] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:57:49.325892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:49.331646 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:49.351189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e593e-5579-44af-be12-0a60fd5f646e service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:49.358549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:49.362973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:49.362973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:49.362973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] PATH_INFO: `/v3/users/69b61fc083db45f9b9aeb1d1d6e03884` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:49.362973 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b61fc083db45f9b9aeb1d1d6e03884)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:49.364974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:49.554289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b61fc083db45f9b9aeb1d1d6e03884'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.578874 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf44fb-2fe6-495c-9c73-553922c7c01a service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:49.580544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4bbf44fb-2fe6-495c-9c73-553922c7c01a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:49.604655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf44fb-2fe6-495c-9c73-553922c7c01a service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:49.610369 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:49.611254 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:49.611536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:49.611998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] PATH_INFO: `/v3/projects/31d1a5a385814ec08cc988f065465cba` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:49.613192 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d1a5a385814ec08cc988f065465cba)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:49.615680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:49.657123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b61fc083db45f9b9aeb1d1d6e03884'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.684329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b61fc083db45f9b9aeb1d1d6e03884'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.685263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b61fc083db45f9b9aeb1d1d6e03884'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.692649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-0f86f66a-7d05-481c-9793-057376406c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b61fc083db45f9b9aeb1d1d6e03884'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.699437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1299/2570] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:49 2022] DELETE /identity/v3/users/69b61fc083db45f9b9aeb1d1d6e03884 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:49.704178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02e072-10d1-4fc9-9dae-e57786968f81 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:49.704773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02e072-10d1-4fc9-9dae-e57786968f81 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:49.705285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02e072-10d1-4fc9-9dae-e57786968f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:49.725512 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-ec02e072-10d1-4fc9-9dae-e57786968f81 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:49.727968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ec02e072-10d1-4fc9-9dae-e57786968f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:49.774156 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d1a5a385814ec08cc988f065465cba', 'request_id': 'req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.784162 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d1a5a385814ec08cc988f065465cba', 'request_id': 'req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.817864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1300/2571] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:49.829662 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02e072-10d1-4fc9-9dae-e57786968f81 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:49.831206 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ec02e072-10d1-4fc9-9dae-e57786968f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:49.847880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d1a5a385814ec08cc988f065465cba', 'request_id': 'req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.878033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] The token cache is being invalidate because project 31d1a5a385814ec08cc988f065465cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:49.879252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.880239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:49.882845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1272/2572] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:49 2022] DELETE /identity/v3/projects/31d1a5a385814ec08cc988f065465cba => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:49.887337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:49.897831 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:49.910336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:49.926118 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02e072-10d1-4fc9-9dae-e57786968f81 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:49.987029 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edc1aa-744e-44f6-a457-7c1cbc76fd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:49.987787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edc1aa-744e-44f6-a457-7c1cbc76fd36 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:49.988936 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edc1aa-744e-44f6-a457-7c1cbc76fd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:49.989228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edc1aa-744e-44f6-a457-7c1cbc76fd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:50.000922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a4edc1aa-744e-44f6-a457-7c1cbc76fd36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:50.010476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5c6a8-4fd9-4ff2-b270-8423ac11a52c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:50.018377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:50.019546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:50.019895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:50.020876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] PATH_INFO: `/v3/users/29c7e640b9094d34b24be6d6e2df1eb8` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:50.023988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edc1aa-744e-44f6-a457-7c1cbc76fd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:50.024861 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c7e640b9094d34b24be6d6e2df1eb8)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:50.029335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edc1aa-744e-44f6-a457-7c1cbc76fd36 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:50.035028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:50.048740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1301/2573] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:57:50.293958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c7e640b9094d34b24be6d6e2df1eb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:50.297363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:50.395493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c7e640b9094d34b24be6d6e2df1eb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:50.396273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c7e640b9094d34b24be6d6e2df1eb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:50.422926 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c7e640b9094d34b24be6d6e2df1eb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:50.428203 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c7e640b9094d34b24be6d6e2df1eb8'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:50.444809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1273/2574] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:49 2022] DELETE /identity/v3/users/29c7e640b9094d34b24be6d6e2df1eb8 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:50.774399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad2136-e2cf-4eea-95df-bdfe60972c6f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:50.774946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad2136-e2cf-4eea-95df-bdfe60972c6f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:50.774946 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad2136-e2cf-4eea-95df-bdfe60972c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:50.801411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-0bad2136-e2cf-4eea-95df-bdfe60972c6f None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:50.802922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0bad2136-e2cf-4eea-95df-bdfe60972c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:50.828787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:50.837014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:50.879020 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1302/2575] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:50.909448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad2136-e2cf-4eea-95df-bdfe60972c6f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:50.911262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0bad2136-e2cf-4eea-95df-bdfe60972c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:50.946085 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ae9a-8839-47aa-a7fb-07527672f288 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:50.951049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:50.951916 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:50.952204 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:50.952481 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] PATH_INFO: `/v3/projects/4199a2f39a1d4b2aa2ebfda6fd5fb6ba` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:50.953915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4199a2f39a1d4b2aa2ebfda6fd5fb6ba)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:50.955771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:51.012142 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad2136-e2cf-4eea-95df-bdfe60972c6f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:51.019230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc51d5-8c02-42d8-9470-3adfb502bc12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:51.019914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc51d5-8c02-42d8-9470-3adfb502bc12 service swift] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:51.020205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc51d5-8c02-42d8-9470-3adfb502bc12 service swift] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:51.021265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc51d5-8c02-42d8-9470-3adfb502bc12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:51.030689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc51d5-8c02-42d8-9470-3adfb502bc12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:51.032420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc51d5-8c02-42d8-9470-3adfb502bc12 service swift] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:51.046335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1303/2576] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:57:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:57:51.047357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc51d5-8c02-42d8-9470-3adfb502bc12 service swift] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:51.049132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-72cc51d5-8c02-42d8-9470-3adfb502bc12 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:51.066894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc51d5-8c02-42d8-9470-3adfb502bc12 service swift] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:51.080916 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4199a2f39a1d4b2aa2ebfda6fd5fb6ba', 'request_id': 'req-3873b345-ccf6-45cf-8332-d95f4b55509a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.093781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4199a2f39a1d4b2aa2ebfda6fd5fb6ba', 'request_id': 'req-3873b345-ccf6-45cf-8332-d95f4b55509a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.104933 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:51.135120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:51.136004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:51.136302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:51.136576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] PATH_INFO: `/v3/projects/436562379e1244138d4812d848048032` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:51.137865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436562379e1244138d4812d848048032)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:51.152396 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:51.213880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4199a2f39a1d4b2aa2ebfda6fd5fb6ba', 'request_id': 'req-3873b345-ccf6-45cf-8332-d95f4b55509a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.231106 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] The token cache is being invalidate because project 4199a2f39a1d4b2aa2ebfda6fd5fb6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:51.231471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.232759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.234901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1274/2577] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:50 2022] DELETE /identity/v3/projects/4199a2f39a1d4b2aa2ebfda6fd5fb6ba => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:51.239323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:51.240652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:51.256994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873b345-ccf6-45cf-8332-d95f4b55509a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:51.266016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436562379e1244138d4812d848048032', 'request_id': 'req-21329869-eca9-41dd-9cbf-2b23300f7a34'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.340406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:51.344296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436562379e1244138d4812d848048032', 'request_id': 'req-21329869-eca9-41dd-9cbf-2b23300f7a34'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.349459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:51.352909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:51.352909 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:51.353095 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436562379e1244138d4812d848048032', 'request_id': 'req-21329869-eca9-41dd-9cbf-2b23300f7a34'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.353200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] PATH_INFO: `/v3/users/9d58c39e4c764eeb9a5292f16640531a` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:51.353279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d58c39e4c764eeb9a5292f16640531a)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:51.355495 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:51.364117 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] The token cache is being invalidate because project 436562379e1244138d4812d848048032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:51.364579 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.365310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-21329869-eca9-41dd-9cbf-2b23300f7a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.367011 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1304/2578] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:51 2022] DELETE /identity/v3/projects/436562379e1244138d4812d848048032 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:51.376083 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c8f2-33c3-4524-a173-b77a871c1512 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:51.376392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c8f2-33c3-4524-a173-b77a871c1512 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:51.376676 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c8f2-33c3-4524-a173-b77a871c1512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:51.397131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7cf8c8f2-33c3-4524-a173-b77a871c1512 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:51.399119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7cf8c8f2-33c3-4524-a173-b77a871c1512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:51.415039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1305/2579] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:51.421756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059655d-8bad-4e83-abd9-19741647ae50 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:51.421756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059655d-8bad-4e83-abd9-19741647ae50 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:51.421756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059655d-8bad-4e83-abd9-19741647ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:51.445232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-8059655d-8bad-4e83-abd9-19741647ae50 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:51.446573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-8059655d-8bad-4e83-abd9-19741647ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:51.475421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1306/2580] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:51.476458 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059655d-8bad-4e83-abd9-19741647ae50 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:51.487824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059655d-8bad-4e83-abd9-19741647ae50 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:51.493666 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06b353-69df-4a1d-bd98-df3adb512634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:51.494410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06b353-69df-4a1d-bd98-df3adb512634 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:51.494723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06b353-69df-4a1d-bd98-df3adb512634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:51.494998 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06b353-69df-4a1d-bd98-df3adb512634 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:51.495762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06b353-69df-4a1d-bd98-df3adb512634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:51.496074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06b353-69df-4a1d-bd98-df3adb512634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:51.497749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06b353-69df-4a1d-bd98-df3adb512634 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:51.511922 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1307/2581] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:57:51.515747 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06b353-69df-4a1d-bd98-df3adb512634 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:51.527466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06b353-69df-4a1d-bd98-df3adb512634 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:51.533065 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433562e-ab26-458d-96a0-971dd50cc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:51.534030 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433562e-ab26-458d-96a0-971dd50cc3ff admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:51.534324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433562e-ab26-458d-96a0-971dd50cc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:51.534608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433562e-ab26-458d-96a0-971dd50cc3ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:51.535486 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433562e-ab26-458d-96a0-971dd50cc3ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:51.537535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433562e-ab26-458d-96a0-971dd50cc3ff admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:51.605699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d58c39e4c764eeb9a5292f16640531a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.644299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1308/2582] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:51 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:51.648281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433562e-ab26-458d-96a0-971dd50cc3ff admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:51.686878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d58c39e4c764eeb9a5292f16640531a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.687524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d58c39e4c764eeb9a5292f16640531a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.718558 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d58c39e4c764eeb9a5292f16640531a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.720231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d58c39e4c764eeb9a5292f16640531a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:51.740115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1275/2583] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:51 2022] DELETE /identity/v3/users/9d58c39e4c764eeb9a5292f16640531a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:51.801897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433562e-ab26-458d-96a0-971dd50cc3ff admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:51.848533 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:51.928131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75d1b-e6ac-48e3-a064-02e7ec2ac282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:51.928874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75d1b-e6ac-48e3-a064-02e7ec2ac282 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:51.929227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75d1b-e6ac-48e3-a064-02e7ec2ac282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:51.929437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75d1b-e6ac-48e3-a064-02e7ec2ac282 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:51.930212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf75d1b-e6ac-48e3-a064-02e7ec2ac282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:51.932154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf75d1b-e6ac-48e3-a064-02e7ec2ac282 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.082963 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1309/2584] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:51 2022] POST /identity/v3/users => generated 288 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:52.086671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.088681 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.104216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127a91-c40e-42eb-8fc9-7373f520fc28 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.109196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2f37-f671-4aaa-9787-fdefa05d3b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.118949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2f37-f671-4aaa-9787-fdefa05d3b10 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.118949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2f37-f671-4aaa-9787-fdefa05d3b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.118949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2f37-f671-4aaa-9787-fdefa05d3b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.118949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d2f37-f671-4aaa-9787-fdefa05d3b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.118949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d2f37-f671-4aaa-9787-fdefa05d3b10 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.127502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1276/2585] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:52.129431 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75d1b-e6ac-48e3-a064-02e7ec2ac282 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.143780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75d1b-e6ac-48e3-a064-02e7ec2ac282 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.149954 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145ee67-2f85-4934-b637-db5a7a0b1619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.150642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145ee67-2f85-4934-b637-db5a7a0b1619 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.150938 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145ee67-2f85-4934-b637-db5a7a0b1619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.151199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145ee67-2f85-4934-b637-db5a7a0b1619 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.151928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145ee67-2f85-4934-b637-db5a7a0b1619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.153560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145ee67-2f85-4934-b637-db5a7a0b1619 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.165077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1310/2586] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:52.169211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2f37-f671-4aaa-9787-fdefa05d3b10 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.183968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2f37-f671-4aaa-9787-fdefa05d3b10 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.189520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafd243-eb9a-4470-9b61-e564197ae166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.190814 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd243-eb9a-4470-9b61-e564197ae166 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.191273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd243-eb9a-4470-9b61-e564197ae166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.194492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd243-eb9a-4470-9b61-e564197ae166 admin admin] PATH_INFO: `/v3/projects/adb130ba45434aa09eeed50bb67ab333/users/0644e0e484cf4c65aaca522a48d4c647/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.218354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd243-eb9a-4470-9b61-e564197ae166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb130ba45434aa09eeed50bb67ab333, user_id=0644e0e484cf4c65aaca522a48d4c647, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.218354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd243-eb9a-4470-9b61-e564197ae166 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.221487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145ee67-2f85-4934-b637-db5a7a0b1619 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.223887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9145ee67-2f85-4934-b637-db5a7a0b1619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.241080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145ee67-2f85-4934-b637-db5a7a0b1619 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.248325 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.249202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.249487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.249761 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] PATH_INFO: `/v3/projects/5be1f8aaa7b84107b236e36fdc439e4e` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.251159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be1f8aaa7b84107b236e36fdc439e4e)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.253256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.322619 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1277/2587] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:52 2022] PUT /identity/v3/projects/adb130ba45434aa09eeed50bb67ab333/users/0644e0e484cf4c65aaca522a48d4c647/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:52.324016 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc00d66-f512-4342-a119-29b8b2d295b3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.324339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc00d66-f512-4342-a119-29b8b2d295b3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.324626 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc00d66-f512-4342-a119-29b8b2d295b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.351604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6cc00d66-f512-4342-a119-29b8b2d295b3 None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:52.352849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6cc00d66-f512-4342-a119-29b8b2d295b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.409694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be1f8aaa7b84107b236e36fdc439e4e', 'request_id': 'req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:52.429200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1278/2588] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 10:57:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:52.431455 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317417-a22c-476f-855d-5c8a518a13be None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.431969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317417-a22c-476f-855d-5c8a518a13be None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.432274 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317417-a22c-476f-855d-5c8a518a13be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.471787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-60317417-a22c-476f-855d-5c8a518a13be None None] MFA Rules not processed for user `0644e0e484cf4c65aaca522a48d4c647`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:52.473755 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-60317417-a22c-476f-855d-5c8a518a13be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.491536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be1f8aaa7b84107b236e36fdc439e4e', 'request_id': 'req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:52.499887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be1f8aaa7b84107b236e36fdc439e4e', 'request_id': 'req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:52.514167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] The token cache is being invalidate because project 5be1f8aaa7b84107b236e36fdc439e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:52.514464 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:52.515363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:52.517203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1311/2589] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:52 2022] DELETE /identity/v3/projects/5be1f8aaa7b84107b236e36fdc439e4e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:52.518133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.519509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.522491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:52.565748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1279/2590] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:52.567168 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057013b2-8792-4c58-83cc-e148d28cf7c8 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.567469 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057013b2-8792-4c58-83cc-e148d28cf7c8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.567753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057013b2-8792-4c58-83cc-e148d28cf7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.598765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-057013b2-8792-4c58-83cc-e148d28cf7c8 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:52.600937 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-057013b2-8792-4c58-83cc-e148d28cf7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.649680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f2fef-af31-4b77-a578-4d3b5fe6ce9b admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.657625 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41fc7d-845b-4b12-bfe6-a42493073794 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.659075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41fc7d-845b-4b12-bfe6-a42493073794 service swift] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.659507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41fc7d-845b-4b12-bfe6-a42493073794 service swift] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.659944 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41fc7d-845b-4b12-bfe6-a42493073794 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.663471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-af41fc7d-845b-4b12-bfe6-a42493073794 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.701264 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1280/2591] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:52.702773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057013b2-8792-4c58-83cc-e148d28cf7c8 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.708680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-057013b2-8792-4c58-83cc-e148d28cf7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.719144 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057013b2-8792-4c58-83cc-e148d28cf7c8 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.720903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:52.727006 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a89c27-3a10-4234-89fa-fcd6a8aaac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.727494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a89c27-3a10-4234-89fa-fcd6a8aaac56 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.727792 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a89c27-3a10-4234-89fa-fcd6a8aaac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.728078 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a89c27-3a10-4234-89fa-fcd6a8aaac56 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.728786 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a89c27-3a10-4234-89fa-fcd6a8aaac56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.730837 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a89c27-3a10-4234-89fa-fcd6a8aaac56 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.792841 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41fc7d-845b-4b12-bfe6-a42493073794 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.795565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41fc7d-845b-4b12-bfe6-a42493073794 service swift] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.806172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1312/2592] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:57:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:57:52.807837 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f324c0-1fa1-4ab1-8daf-4cb08f025772 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.808189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f324c0-1fa1-4ab1-8daf-4cb08f025772 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.808534 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f324c0-1fa1-4ab1-8daf-4cb08f025772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.825516 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1281/2593] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:52 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:52.826956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a89c27-3a10-4234-89fa-fcd6a8aaac56 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.840037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-26f324c0-1fa1-4ab1-8daf-4cb08f025772 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:52.842511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-26f324c0-1fa1-4ab1-8daf-4cb08f025772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.920040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1313/2594] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:52.924759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f324c0-1fa1-4ab1-8daf-4cb08f025772 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.933561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a89c27-3a10-4234-89fa-fcd6a8aaac56 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.935475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f324c0-1fa1-4ab1-8daf-4cb08f025772 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.939821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d5f5-ea97-4437-ba74-a8651fb3577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.940665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d5f5-ea97-4437-ba74-a8651fb3577b admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.941002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d5f5-ea97-4437-ba74-a8651fb3577b admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.941290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d5f5-ea97-4437-ba74-a8651fb3577b admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.942195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5d5f5-ea97-4437-ba74-a8651fb3577b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.943279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb2bf6-1b5a-457a-b202-ad75f7af5eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.944191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb2bf6-1b5a-457a-b202-ad75f7af5eee admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.944394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5d5f5-ea97-4437-ba74-a8651fb3577b admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.944901 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb2bf6-1b5a-457a-b202-ad75f7af5eee admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.945455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb2bf6-1b5a-457a-b202-ad75f7af5eee admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.947006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb2bf6-1b5a-457a-b202-ad75f7af5eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:52.947919 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb2bf6-1b5a-457a-b202-ad75f7af5eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.951262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb2bf6-1b5a-457a-b202-ad75f7af5eee admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.968624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1314/2595] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:57:52.973055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb2bf6-1b5a-457a-b202-ad75f7af5eee admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.986182 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb2bf6-1b5a-457a-b202-ad75f7af5eee admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.991602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81605f-528e-48f6-9d0b-e405bddc45c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.992377 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81605f-528e-48f6-9d0b-e405bddc45c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.992671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81605f-528e-48f6-9d0b-e405bddc45c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.992952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81605f-528e-48f6-9d0b-e405bddc45c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.993737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81605f-528e-48f6-9d0b-e405bddc45c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.995737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81605f-528e-48f6-9d0b-e405bddc45c4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.088688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1282/2596] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:52 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:53.093389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d5f5-ea97-4437-ba74-a8651fb3577b admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.103171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d5f5-ea97-4437-ba74-a8651fb3577b admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.111501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c98d9-3477-425f-9be0-a7bd24411f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.112215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c98d9-3477-425f-9be0-a7bd24411f56 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.116557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c98d9-3477-425f-9be0-a7bd24411f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.116557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c98d9-3477-425f-9be0-a7bd24411f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.116557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c98d9-3477-425f-9be0-a7bd24411f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.116557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c98d9-3477-425f-9be0-a7bd24411f56 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.119630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1315/2597] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:52 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:53.124809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81605f-528e-48f6-9d0b-e405bddc45c4 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.126576 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1283/2598] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:53.130649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c98d9-3477-425f-9be0-a7bd24411f56 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.142329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c98d9-3477-425f-9be0-a7bd24411f56 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.208540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:53.235840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81605f-528e-48f6-9d0b-e405bddc45c4 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.242470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be835-67fc-4ff8-933b-bb28ad81ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.243307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be835-67fc-4ff8-933b-bb28ad81ef1c admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.243981 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b6a36-5110-4f9a-8c5d-d08403fdc96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.244384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be835-67fc-4ff8-933b-bb28ad81ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.244737 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be835-67fc-4ff8-933b-bb28ad81ef1c admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.244900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b6a36-5110-4f9a-8c5d-d08403fdc96c admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.245171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b6a36-5110-4f9a-8c5d-d08403fdc96c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.245465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b6a36-5110-4f9a-8c5d-d08403fdc96c admin admin] PATH_INFO: `/v3/projects/a3fcfe68e2634202b73d8fbb3a376063/users/dbe48837fa234e26a0c1dedd1aac9b5f/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.245859 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2be835-67fc-4ff8-933b-bb28ad81ef1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.247891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2be835-67fc-4ff8-933b-bb28ad81ef1c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.263069 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b6a36-5110-4f9a-8c5d-d08403fdc96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fcfe68e2634202b73d8fbb3a376063, user_id=dbe48837fa234e26a0c1dedd1aac9b5f, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.265813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b6a36-5110-4f9a-8c5d-d08403fdc96c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.324031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1316/2599] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:53 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:53.338961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be835-67fc-4ff8-933b-bb28ad81ef1c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.340729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2c2be835-67fc-4ff8-933b-bb28ad81ef1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:53.366822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:53.378967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1284/2600] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:53 2022] PUT /identity/v3/projects/a3fcfe68e2634202b73d8fbb3a376063/users/dbe48837fa234e26a0c1dedd1aac9b5f/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:53.380057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b6a36-5110-4f9a-8c5d-d08403fdc96c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.408994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be835-67fc-4ff8-933b-bb28ad81ef1c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.443725 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b6a36-5110-4f9a-8c5d-d08403fdc96c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.448922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9df6e4-89b0-4d91-93d7-c533516209a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.449594 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9df6e4-89b0-4d91-93d7-c533516209a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.449881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9df6e4-89b0-4d91-93d7-c533516209a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.450189 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9df6e4-89b0-4d91-93d7-c533516209a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.450922 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9df6e4-89b0-4d91-93d7-c533516209a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.452545 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9df6e4-89b0-4d91-93d7-c533516209a2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.460545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512288-7af8-407c-84cf-6ce050ab0867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.461914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512288-7af8-407c-84cf-6ce050ab0867 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.462240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512288-7af8-407c-84cf-6ce050ab0867 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.462522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512288-7af8-407c-84cf-6ce050ab0867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.467561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1285/2601] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:53.467713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-65512288-7af8-407c-84cf-6ce050ab0867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:53.467807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9df6e4-89b0-4d91-93d7-c533516209a2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.475290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9df6e4-89b0-4d91-93d7-c533516209a2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.480427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2013c29-b4c7-431e-89d0-9d13b00d9ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.481048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2013c29-b4c7-431e-89d0-9d13b00d9ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.481370 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2013c29-b4c7-431e-89d0-9d13b00d9ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.481704 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2013c29-b4c7-431e-89d0-9d13b00d9ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.482364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2013c29-b4c7-431e-89d0-9d13b00d9ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.483971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2013c29-b4c7-431e-89d0-9d13b00d9ad0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.486127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512288-7af8-407c-84cf-6ce050ab0867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.487588 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512288-7af8-407c-84cf-6ce050ab0867 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.513766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1317/2602] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:53.514631 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1286/2603] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:53.518443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2013c29-b4c7-431e-89d0-9d13b00d9ad0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.518968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512288-7af8-407c-84cf-6ce050ab0867 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.532968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2013c29-b4c7-431e-89d0-9d13b00d9ad0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.535884 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512288-7af8-407c-84cf-6ce050ab0867 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.538174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee680f69-f856-4cff-ae58-1fec82ed0f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.539097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee680f69-f856-4cff-ae58-1fec82ed0f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.539389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee680f69-f856-4cff-ae58-1fec82ed0f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.539678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee680f69-f856-4cff-ae58-1fec82ed0f3a admin admin] PATH_INFO: `/v3/projects/a3fcfe68e2634202b73d8fbb3a376063/users/dbe48837fa234e26a0c1dedd1aac9b5f/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.543529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0507de-c38f-44f6-adc9-8fffbfbd7fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.543712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee680f69-f856-4cff-ae58-1fec82ed0f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fcfe68e2634202b73d8fbb3a376063, user_id=dbe48837fa234e26a0c1dedd1aac9b5f, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.544781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0507de-c38f-44f6-adc9-8fffbfbd7fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.545219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0507de-c38f-44f6-adc9-8fffbfbd7fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.545702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0507de-c38f-44f6-adc9-8fffbfbd7fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.546532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee680f69-f856-4cff-ae58-1fec82ed0f3a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.551805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0507de-c38f-44f6-adc9-8fffbfbd7fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.551805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0507de-c38f-44f6-adc9-8fffbfbd7fb5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.560873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1318/2604] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:53.561485 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1287/2605] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:53 2022] PUT /identity/v3/projects/a3fcfe68e2634202b73d8fbb3a376063/users/dbe48837fa234e26a0c1dedd1aac9b5f/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:53.570806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0507de-c38f-44f6-adc9-8fffbfbd7fb5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.575089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1b18-cbdb-4645-a6eb-40b3dfad16b2 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.580180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1b18-cbdb-4645-a6eb-40b3dfad16b2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.580180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1b18-cbdb-4645-a6eb-40b3dfad16b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.582238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0507de-c38f-44f6-adc9-8fffbfbd7fb5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.606026 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-46da1b18-cbdb-4645-a6eb-40b3dfad16b2 None None] MFA Rules not processed for user `dbe48837fa234e26a0c1dedd1aac9b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:53.608931 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-46da1b18-cbdb-4645-a6eb-40b3dfad16b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:53.658715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d45dc-3ac8-48d0-9826-a75269b1ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.660094 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d45dc-3ac8-48d0-9826-a75269b1ed47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.662077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d45dc-3ac8-48d0-9826-a75269b1ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.662247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d45dc-3ac8-48d0-9826-a75269b1ed47 admin admin] PATH_INFO: `/v3/projects/125d0f4ce0c346a8bb0caa662e1b1f65/users/10a895fd842c4ee0a3e5d9de91047258/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.682247 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d45dc-3ac8-48d0-9826-a75269b1ed47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125d0f4ce0c346a8bb0caa662e1b1f65, user_id=10a895fd842c4ee0a3e5d9de91047258, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.685681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d45dc-3ac8-48d0-9826-a75269b1ed47 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.693222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1288/2606] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:53.698605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310787e-d5bb-4c78-bd9b-5297918b06ea None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.698906 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310787e-d5bb-4c78-bd9b-5297918b06ea None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.699463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310787e-d5bb-4c78-bd9b-5297918b06ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.717213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-2310787e-d5bb-4c78-bd9b-5297918b06ea None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:53.718712 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2310787e-d5bb-4c78-bd9b-5297918b06ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:53.727564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:53.760824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1319/2607] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:53 2022] PUT /identity/v3/projects/125d0f4ce0c346a8bb0caa662e1b1f65/users/10a895fd842c4ee0a3e5d9de91047258/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:53.761547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d45dc-3ac8-48d0-9826-a75269b1ed47 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.769120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-104d45dc-3ac8-48d0-9826-a75269b1ed47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:53.791386 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1289/2608] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 10:57:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:53.793165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d96f8-d9b9-4dcc-bd4e-9fd37cc87da4 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.793673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d96f8-d9b9-4dcc-bd4e-9fd37cc87da4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.794080 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d96f8-d9b9-4dcc-bd4e-9fd37cc87da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.831817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9f4d96f8-d9b9-4dcc-bd4e-9fd37cc87da4 None None] MFA Rules not processed for user `10a895fd842c4ee0a3e5d9de91047258`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:53.832993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9f4d96f8-d9b9-4dcc-bd4e-9fd37cc87da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:53.840412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d45dc-3ac8-48d0-9826-a75269b1ed47 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:53.844821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da3ef0-9fe0-466b-8c77-94a581d24ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:53.845516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da3ef0-9fe0-466b-8c77-94a581d24ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:53.845818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da3ef0-9fe0-466b-8c77-94a581d24ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:53.846147 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da3ef0-9fe0-466b-8c77-94a581d24ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:53.851780 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:53.916193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da3ef0-9fe0-466b-8c77-94a581d24ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:53.917647 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da3ef0-9fe0-466b-8c77-94a581d24ee8 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:53.922456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1290/2609] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:53.922456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d96f8-d9b9-4dcc-bd4e-9fd37cc87da4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:53.930952 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1320/2610] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:53.932165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da3ef0-9fe0-466b-8c77-94a581d24ee8 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:54.018097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d96f8-d9b9-4dcc-bd4e-9fd37cc87da4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:54.025325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0dcf-de48-488a-8d47-28df646916c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:54.026482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0dcf-de48-488a-8d47-28df646916c1 service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.027030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0dcf-de48-488a-8d47-28df646916c1 service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.027490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0dcf-de48-488a-8d47-28df646916c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:54.028807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da3ef0-9fe0-466b-8c77-94a581d24ee8 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:54.038665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37859944-51e1-4eb7-928e-04f47ffea35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:54.039966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37859944-51e1-4eb7-928e-04f47ffea35e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.040361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37859944-51e1-4eb7-928e-04f47ffea35e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.040749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37859944-51e1-4eb7-928e-04f47ffea35e admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:54.041565 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37859944-51e1-4eb7-928e-04f47ffea35e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:54.043853 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37859944-51e1-4eb7-928e-04f47ffea35e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:54.112375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:54.123649 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f0dcf-de48-488a-8d47-28df646916c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:54.125152 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f0dcf-de48-488a-8d47-28df646916c1 service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:54.134924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1291/2611] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:57:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:57:54.159082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1321/2612] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:53 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:54.163201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0dcf-de48-488a-8d47-28df646916c1 service swift] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:54.174962 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0dcf-de48-488a-8d47-28df646916c1 service swift] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:54.237217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfed67-c161-48f0-8fd4-2abd16624b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:54.237887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfed67-c161-48f0-8fd4-2abd16624b2e admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.238215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfed67-c161-48f0-8fd4-2abd16624b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.238493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfed67-c161-48f0-8fd4-2abd16624b2e admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:54.239395 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfed67-c161-48f0-8fd4-2abd16624b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:54.243222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfed67-c161-48f0-8fd4-2abd16624b2e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:54.390197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1292/2613] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:54 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:54.394157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37859944-51e1-4eb7-928e-04f47ffea35e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:54.405273 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37859944-51e1-4eb7-928e-04f47ffea35e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:54.411317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e020460-b342-4992-8f14-f68b8186998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:54.411430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e020460-b342-4992-8f14-f68b8186998b admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.411717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e020460-b342-4992-8f14-f68b8186998b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.411985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e020460-b342-4992-8f14-f68b8186998b admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:54.412777 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e020460-b342-4992-8f14-f68b8186998b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:54.415021 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e020460-b342-4992-8f14-f68b8186998b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:54.435393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1322/2614] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:54.439818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfed67-c161-48f0-8fd4-2abd16624b2e admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:54.454628 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfed67-c161-48f0-8fd4-2abd16624b2e admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:54.460174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f69e6-b8f9-48cc-9b39-c21445a1549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:54.462851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f69e6-b8f9-48cc-9b39-c21445a1549a admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.463147 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f69e6-b8f9-48cc-9b39-c21445a1549a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.463430 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f69e6-b8f9-48cc-9b39-c21445a1549a admin admin] PATH_INFO: `/v3/projects/95e179fa55a041a6a4ba4025f5eae5d8/users/49ce69275fdd4df389b0fb104cead9df/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:54.484239 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f69e6-b8f9-48cc-9b39-c21445a1549a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e179fa55a041a6a4ba4025f5eae5d8, user_id=49ce69275fdd4df389b0fb104cead9df, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:54.486974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f69e6-b8f9-48cc-9b39-c21445a1549a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:54.590334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1293/2615] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:54 2022] PUT /identity/v3/projects/95e179fa55a041a6a4ba4025f5eae5d8/users/49ce69275fdd4df389b0fb104cead9df/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:54.594551 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e020460-b342-4992-8f14-f68b8186998b admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:54.606700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e020460-b342-4992-8f14-f68b8186998b admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:54.681340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fe395-5c6f-466c-b847-241349c72d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:54.682052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe395-5c6f-466c-b847-241349c72d83 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.682363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe395-5c6f-466c-b847-241349c72d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.682614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe395-5c6f-466c-b847-241349c72d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:54.683352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fe395-5c6f-466c-b847-241349c72d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:54.684966 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fe395-5c6f-466c-b847-241349c72d83 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:54.697289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1323/2616] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:57:54.705263 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f69e6-b8f9-48cc-9b39-c21445a1549a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:54.720625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f69e6-b8f9-48cc-9b39-c21445a1549a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:54.739535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2999ba4-8868-46f9-be79-29ef28aacb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:54.740778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999ba4-8868-46f9-be79-29ef28aacb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.741330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999ba4-8868-46f9-be79-29ef28aacb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.741724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999ba4-8868-46f9-be79-29ef28aacb6d admin admin] PATH_INFO: `/v3/projects/95e179fa55a041a6a4ba4025f5eae5d8/users/49ce69275fdd4df389b0fb104cead9df/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:54.743938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2999ba4-8868-46f9-be79-29ef28aacb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e179fa55a041a6a4ba4025f5eae5d8, user_id=49ce69275fdd4df389b0fb104cead9df, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:54.752857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2999ba4-8868-46f9-be79-29ef28aacb6d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:54.762100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1294/2617] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:54 2022] PUT /identity/v3/projects/95e179fa55a041a6a4ba4025f5eae5d8/users/49ce69275fdd4df389b0fb104cead9df/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:54.773268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f846752-ac79-4308-a736-9acc56b65a65 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.774249 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f846752-ac79-4308-a736-9acc56b65a65 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.774635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f846752-ac79-4308-a736-9acc56b65a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:54.816659 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7f846752-ac79-4308-a736-9acc56b65a65 None None] MFA Rules not processed for user `49ce69275fdd4df389b0fb104cead9df`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:54.818607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7f846752-ac79-4308-a736-9acc56b65a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:54.824492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:54.871157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bacf0-a497-4688-98bb-0eed7ecf2321 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.871340 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bacf0-a497-4688-98bb-0eed7ecf2321 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.871685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bacf0-a497-4688-98bb-0eed7ecf2321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:54.906268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-603bacf0-a497-4688-98bb-0eed7ecf2321 None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:54.907523 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-603bacf0-a497-4688-98bb-0eed7ecf2321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:54.911984 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1324/2618] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:54.924054 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f846752-ac79-4308-a736-9acc56b65a65 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:54.981436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1295/2619] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:54.993545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f846752-ac79-4308-a736-9acc56b65a65 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:54.994308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bacf0-a497-4688-98bb-0eed7ecf2321 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:54.996864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2f7d-aaf0-4d04-90bd-bd9dbc17a6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:54.997598 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2f7d-aaf0-4d04-90bd-bd9dbc17a6da service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:54.997986 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2f7d-aaf0-4d04-90bd-bd9dbc17a6da service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:54.998344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2f7d-aaf0-4d04-90bd-bd9dbc17a6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:55.010233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b2f7d-aaf0-4d04-90bd-bd9dbc17a6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:55.011697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b2f7d-aaf0-4d04-90bd-bd9dbc17a6da service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:55.022653 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1325/2620] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:55.052676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:55.073223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bacf0-a497-4688-98bb-0eed7ecf2321 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:55.078486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ed8ef-9628-4098-8648-3df5657da0c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:55.084213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed8ef-9628-4098-8648-3df5657da0c3 service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:55.084213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed8ef-9628-4098-8648-3df5657da0c3 service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:55.084213 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed8ef-9628-4098-8648-3df5657da0c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:55.088127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ed8ef-9628-4098-8648-3df5657da0c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:55.089721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ed8ef-9628-4098-8648-3df5657da0c3 service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:55.098432 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1296/2621] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 10:57:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 10:57:56.277209 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2f7d-aaf0-4d04-90bd-bd9dbc17a6da service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:56.373203 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2f7d-aaf0-4d04-90bd-bd9dbc17a6da service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:56.378589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:56.379786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:56.380301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:56.381065 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] PATH_INFO: `/v3/users/10a895fd842c4ee0a3e5d9de91047258` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:56.382562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a895fd842c4ee0a3e5d9de91047258)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:56.385280 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:56.656379 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:56.658514 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a895fd842c4ee0a3e5d9de91047258'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:56.800263 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a895fd842c4ee0a3e5d9de91047258'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:56.823642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a895fd842c4ee0a3e5d9de91047258'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:56.826366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a895fd842c4ee0a3e5d9de91047258'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:56.845033 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a895fd842c4ee0a3e5d9de91047258'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:56.859470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1326/2622] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:56 2022] DELETE /identity/v3/users/10a895fd842c4ee0a3e5d9de91047258 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:56.864253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea533a49-ec49-4990-9957-d84a1edd7e3d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:56.865196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea533a49-ec49-4990-9957-d84a1edd7e3d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:56.867586 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea533a49-ec49-4990-9957-d84a1edd7e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:56.900882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ea533a49-ec49-4990-9957-d84a1edd7e3d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:56.903100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ea533a49-ec49-4990-9957-d84a1edd7e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:57.005900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1297/2623] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:57.019798 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:57.021381 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:57.162689 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c473b-a28b-43ba-87a0-c4b3a0b46b1a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:57.167214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ba1bb-f705-4817-bf85-5aca1e3e404c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:57.167913 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba1bb-f705-4817-bf85-5aca1e3e404c service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:57.168210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba1bb-f705-4817-bf85-5aca1e3e404c service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:57.168488 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba1bb-f705-4817-bf85-5aca1e3e404c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:57.181248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ba1bb-f705-4817-bf85-5aca1e3e404c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:57.183252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ba1bb-f705-4817-bf85-5aca1e3e404c service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:57.197530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1327/2624] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:57.611606 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea533a49-ec49-4990-9957-d84a1edd7e3d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:57.613103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ea533a49-ec49-4990-9957-d84a1edd7e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:57.626760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea533a49-ec49-4990-9957-d84a1edd7e3d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:57.631919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:57.633630 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:57.634002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:57.634273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] PATH_INFO: `/v3/users/0644e0e484cf4c65aaca522a48d4c647` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:57.635488 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0644e0e484cf4c65aaca522a48d4c647)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:57.637451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:57.868062 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0644e0e484cf4c65aaca522a48d4c647'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:57.904590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ba1bb-f705-4817-bf85-5aca1e3e404c service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:57.906601 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-576ba1bb-f705-4817-bf85-5aca1e3e404c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:57.925234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ba1bb-f705-4817-bf85-5aca1e3e404c service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:57.932456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:57.933412 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:57.933612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:57.933893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] PATH_INFO: `/v3/projects/125d0f4ce0c346a8bb0caa662e1b1f65` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:57.935125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125d0f4ce0c346a8bb0caa662e1b1f65)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:57.937061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:57.955178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0644e0e484cf4c65aaca522a48d4c647'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:57.956122 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0644e0e484cf4c65aaca522a48d4c647'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:57.972436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0644e0e484cf4c65aaca522a48d4c647'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:57.973272 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9a540837-0d63-4460-af42-868c25eb64ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0644e0e484cf4c65aaca522a48d4c647'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:57.987074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1298/2625] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:57 2022] DELETE /identity/v3/users/0644e0e484cf4c65aaca522a48d4c647 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:57.993376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a89e-09c3-4ec8-b981-dd4096b1a222 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:57.993542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a89e-09c3-4ec8-b981-dd4096b1a222 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:57.993993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a89e-09c3-4ec8-b981-dd4096b1a222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:58.021500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ec08a89e-09c3-4ec8-b981-dd4096b1a222 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:58.023896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ec08a89e-09c3-4ec8-b981-dd4096b1a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:58.061505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125d0f4ce0c346a8bb0caa662e1b1f65', 'request_id': 'req-4a40fc91-2902-4f64-ae30-c1261a448967'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.090184 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:58.121371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1299/2626] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:58.152141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08a89e-09c3-4ec8-b981-dd4096b1a222 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:58.163276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ec08a89e-09c3-4ec8-b981-dd4096b1a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:58.262346 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125d0f4ce0c346a8bb0caa662e1b1f65', 'request_id': 'req-4a40fc91-2902-4f64-ae30-c1261a448967'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.270427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125d0f4ce0c346a8bb0caa662e1b1f65', 'request_id': 'req-4a40fc91-2902-4f64-ae30-c1261a448967'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.290328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08a89e-09c3-4ec8-b981-dd4096b1a222 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:58.301227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] The token cache is being invalidate because project 125d0f4ce0c346a8bb0caa662e1b1f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:58.301227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.301227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.301227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1328/2627] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:57 2022] DELETE /identity/v3/projects/125d0f4ce0c346a8bb0caa662e1b1f65 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:58.304370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:58.307322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:58.398034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:58.407686 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:58.408434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:58.408794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:58.409292 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:58.412891 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:58.445655 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40fc91-2902-4f64-ae30-c1261a448967 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:58.483172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:58.484250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:58.484611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:58.485560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] PATH_INFO: `/v3/users/49ce69275fdd4df389b0fb104cead9df` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:58.487502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ce69275fdd4df389b0fb104cead9df)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:58.491152 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:58.571368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:58.572986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:58.588092 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1300/2628] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:58.589930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:58.591436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:58.605667 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb396e-800d-41a5-ad10-d1bedf93f6b5 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:58.614365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:58.615532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:58.615893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:58.616241 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] PATH_INFO: `/v3/users/3c45ba47cd004505acdd20a5de54c7b7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:58.618550 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c45ba47cd004505acdd20a5de54c7b7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:58.620997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:58.760307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ce69275fdd4df389b0fb104cead9df'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.860984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c45ba47cd004505acdd20a5de54c7b7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.866321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:58.908403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ce69275fdd4df389b0fb104cead9df'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.924538 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ce69275fdd4df389b0fb104cead9df'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.925496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ce69275fdd4df389b0fb104cead9df'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.935128 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b386dd57-8e69-4568-afa1-9552845b1944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ce69275fdd4df389b0fb104cead9df'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:58.942836 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1329/2629] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:58 2022] DELETE /identity/v3/users/49ce69275fdd4df389b0fb104cead9df => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:59.020231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c45ba47cd004505acdd20a5de54c7b7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:59.023293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c45ba47cd004505acdd20a5de54c7b7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:59.066466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c45ba47cd004505acdd20a5de54c7b7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:59.067268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c45ba47cd004505acdd20a5de54c7b7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:59.083444 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1301/2630] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:58 2022] DELETE /identity/v3/users/3c45ba47cd004505acdd20a5de54c7b7 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:59.087893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9e9ea-1652-4578-a818-2bbe79075424 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:59.088262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9e9ea-1652-4578-a818-2bbe79075424 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:59.088651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9e9ea-1652-4578-a818-2bbe79075424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:59.106532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-61a9e9ea-1652-4578-a818-2bbe79075424 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:59.107882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-61a9e9ea-1652-4578-a818-2bbe79075424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:59.176049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1330/2631] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:59.216997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:59.218615 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:59.303303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4b96a-b5b0-499b-90a0-34f69ffabcba admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:59.309542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa18f6e-0131-438c-b764-6f8c5469b599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:59.310255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa18f6e-0131-438c-b764-6f8c5469b599 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:59.310536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa18f6e-0131-438c-b764-6f8c5469b599 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:59.310813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa18f6e-0131-438c-b764-6f8c5469b599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:59.324999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa18f6e-0131-438c-b764-6f8c5469b599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:59.324999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa18f6e-0131-438c-b764-6f8c5469b599 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:59.334207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1302/2632] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:59.516060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9e9ea-1652-4578-a818-2bbe79075424 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:59.518399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-61a9e9ea-1652-4578-a818-2bbe79075424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:59.534825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9e9ea-1652-4578-a818-2bbe79075424 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:59.541492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:59.542456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:59.542739 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:59.543013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] PATH_INFO: `/v3/projects/95e179fa55a041a6a4ba4025f5eae5d8` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:59.544213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e179fa55a041a6a4ba4025f5eae5d8)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:59.546472 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:59.672782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e179fa55a041a6a4ba4025f5eae5d8', 'request_id': 'req-b9fb9961-72ca-454a-86af-e18e64b18afe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:59.750238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa18f6e-0131-438c-b764-6f8c5469b599 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:59.750238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3aa18f6e-0131-438c-b764-6f8c5469b599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:59.766803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e179fa55a041a6a4ba4025f5eae5d8', 'request_id': 'req-b9fb9961-72ca-454a-86af-e18e64b18afe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:59.779874 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e179fa55a041a6a4ba4025f5eae5d8', 'request_id': 'req-b9fb9961-72ca-454a-86af-e18e64b18afe'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:59.780155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa18f6e-0131-438c-b764-6f8c5469b599 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:59.786411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:59.803339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] The token cache is being invalidate because project 95e179fa55a041a6a4ba4025f5eae5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:59.811240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:59.811240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:59.811240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1331/2633] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:59 2022] DELETE /identity/v3/projects/95e179fa55a041a6a4ba4025f5eae5d8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:59.811240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:59.811240 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:59.856493 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:59.857508 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:59.857919 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:59.858347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] PATH_INFO: `/v3/projects/adb130ba45434aa09eeed50bb67ab333` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:59.859824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb130ba45434aa09eeed50bb67ab333)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:59.861884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:59.879302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb9961-72ca-454a-86af-e18e64b18afe admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:59.884715 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:59.886078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:59.886372 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:59.886688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] PATH_INFO: `/v3/projects/f37dd679b7f84cfcb34cb40f29c27929` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:59.888417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37dd679b7f84cfcb34cb40f29c27929)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:59.890460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:00.017818 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb130ba45434aa09eeed50bb67ab333', 'request_id': 'req-90fcb679-5f20-44b6-9c2c-dacab1efe310'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.024200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb130ba45434aa09eeed50bb67ab333', 'request_id': 'req-90fcb679-5f20-44b6-9c2c-dacab1efe310'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.046755 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37dd679b7f84cfcb34cb40f29c27929', 'request_id': 'req-e9909415-b79a-417a-814b-06e1cf8eaff9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.125535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb130ba45434aa09eeed50bb67ab333', 'request_id': 'req-90fcb679-5f20-44b6-9c2c-dacab1efe310'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.133896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:00.137910 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] The token cache is being invalidate because project adb130ba45434aa09eeed50bb67ab333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:00.138268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.138968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-90fcb679-5f20-44b6-9c2c-dacab1efe310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.140518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1303/2634] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:59 2022] DELETE /identity/v3/projects/adb130ba45434aa09eeed50bb67ab333 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:58:00.141741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106d51-c2f6-4b4a-8cd1-6576d65c8f1d None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:00.142061 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106d51-c2f6-4b4a-8cd1-6576d65c8f1d None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:00.142342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106d51-c2f6-4b4a-8cd1-6576d65c8f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:00.159813 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4c106d51-c2f6-4b4a-8cd1-6576d65c8f1d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:00.161002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4c106d51-c2f6-4b4a-8cd1-6576d65c8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:00.182213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37dd679b7f84cfcb34cb40f29c27929', 'request_id': 'req-e9909415-b79a-417a-814b-06e1cf8eaff9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.189260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37dd679b7f84cfcb34cb40f29c27929', 'request_id': 'req-e9909415-b79a-417a-814b-06e1cf8eaff9'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.200573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] The token cache is being invalidate because project f37dd679b7f84cfcb34cb40f29c27929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:00.200865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.201545 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.203130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1332/2635] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:59 2022] DELETE /identity/v3/projects/f37dd679b7f84cfcb34cb40f29c27929 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:00.203981 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:00.205293 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:00.235641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1304/2636] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:00.236785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106d51-c2f6-4b4a-8cd1-6576d65c8f1d None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:00.238306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4c106d51-c2f6-4b4a-8cd1-6576d65c8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:00.253851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106d51-c2f6-4b4a-8cd1-6576d65c8f1d None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:00.259127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:00.260198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:00.260475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:00.261231 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] PATH_INFO: `/v3/users/b21bf3717c1045088c5f45a88b6c3b15` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:00.262219 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21bf3717c1045088c5f45a88b6c3b15)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:00.264174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:00.291453 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9909415-b79a-417a-814b-06e1cf8eaff9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:00.298107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:00.298999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:00.299283 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:00.299562 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] PATH_INFO: `/v3/users/ff627a3b938442c3ad700d7cfb76d321` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:00.301086 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff627a3b938442c3ad700d7cfb76d321)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:00.303105 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:00.465357 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21bf3717c1045088c5f45a88b6c3b15'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.499698 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff627a3b938442c3ad700d7cfb76d321'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.572258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21bf3717c1045088c5f45a88b6c3b15'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.572901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21bf3717c1045088c5f45a88b6c3b15'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.586529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21bf3717c1045088c5f45a88b6c3b15'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.587175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21bf3717c1045088c5f45a88b6c3b15'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.599338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1305/2637] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:00 2022] DELETE /identity/v3/users/b21bf3717c1045088c5f45a88b6c3b15 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:00.600109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:00.602083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:00.629891 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff627a3b938442c3ad700d7cfb76d321'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.643928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff627a3b938442c3ad700d7cfb76d321'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.647483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff627a3b938442c3ad700d7cfb76d321'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.653820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-622d9c57-6a37-43b2-9595-20ed02be697c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff627a3b938442c3ad700d7cfb76d321'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:00.660159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1333/2638] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:00 2022] DELETE /identity/v3/users/ff627a3b938442c3ad700d7cfb76d321 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:00.663503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aad2a-13ea-4728-a10b-882cb030ba17 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:00.663503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aad2a-13ea-4728-a10b-882cb030ba17 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:00.663503 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aad2a-13ea-4728-a10b-882cb030ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:00.676463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dbc31-3f0e-4c45-b10c-5f38e5b6d1f7 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:00.681136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b03aad2a-13ea-4728-a10b-882cb030ba17 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:00.682492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b03aad2a-13ea-4728-a10b-882cb030ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:00.743835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:00.744735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:00.745029 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:00.745319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] PATH_INFO: `/v3/users/dbe48837fa234e26a0c1dedd1aac9b5f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:00.746580 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe48837fa234e26a0c1dedd1aac9b5f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:00.748535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:00.768471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1334/2639] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:00.773037 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aad2a-13ea-4728-a10b-882cb030ba17 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:00.785687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aad2a-13ea-4728-a10b-882cb030ba17 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:00.791113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0a699-a627-455c-8075-757e7e544c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:00.791975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a699-a627-455c-8075-757e7e544c42 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:00.792336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a699-a627-455c-8075-757e7e544c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:00.792600 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a699-a627-455c-8075-757e7e544c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:00.793446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0a699-a627-455c-8075-757e7e544c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:58:00.793965 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0a699-a627-455c-8075-757e7e544c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:00.795814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0a699-a627-455c-8075-757e7e544c42 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:00.809560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1335/2640] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:58:00.813824 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0a699-a627-455c-8075-757e7e544c42 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:00.824730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0a699-a627-455c-8075-757e7e544c42 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:00.829411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819fee6-9206-439d-8978-75cd8f27f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:00.830110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819fee6-9206-439d-8978-75cd8f27f124 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:00.830401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819fee6-9206-439d-8978-75cd8f27f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:00.830681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819fee6-9206-439d-8978-75cd8f27f124 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:00.831400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819fee6-9206-439d-8978-75cd8f27f124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:00.833306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819fee6-9206-439d-8978-75cd8f27f124 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:00.972697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1336/2641] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:00 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:00.973569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819fee6-9206-439d-8978-75cd8f27f124 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:00.975334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d819fee6-9206-439d-8978-75cd8f27f124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.016356 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe48837fa234e26a0c1dedd1aac9b5f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.044416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819fee6-9206-439d-8978-75cd8f27f124 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.049068 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:01.049926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.050256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.050516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] PATH_INFO: `/v3/projects/e77fa6d0540c41b1ac418a5599e56e26` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.051722 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77fa6d0540c41b1ac418a5599e56e26)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:01.053614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:01.092830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe48837fa234e26a0c1dedd1aac9b5f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.093452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe48837fa234e26a0c1dedd1aac9b5f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.106273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe48837fa234e26a0c1dedd1aac9b5f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.106978 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe48837fa234e26a0c1dedd1aac9b5f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.119589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1306/2642] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:00 2022] DELETE /identity/v3/users/dbe48837fa234e26a0c1dedd1aac9b5f => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:01.120342 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:01.121678 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.158857 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77fa6d0540c41b1ac418a5599e56e26', 'request_id': 'req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.190185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c6cfa-36ab-4cb2-bd62-3f42758217de admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.246816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77fa6d0540c41b1ac418a5599e56e26', 'request_id': 'req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.248436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62496677-1a7d-47ea-bb13-338088e0fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:01.249097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62496677-1a7d-47ea-bb13-338088e0fb40 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.249395 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62496677-1a7d-47ea-bb13-338088e0fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.249665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62496677-1a7d-47ea-bb13-338088e0fb40 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.250387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62496677-1a7d-47ea-bb13-338088e0fb40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:01.252313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62496677-1a7d-47ea-bb13-338088e0fb40 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:01.253619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77fa6d0540c41b1ac418a5599e56e26', 'request_id': 'req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.264123 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] The token cache is being invalidate because project e77fa6d0540c41b1ac418a5599e56e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:01.264413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.265082 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.266718 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1337/2643] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:00 2022] DELETE /identity/v3/projects/e77fa6d0540c41b1ac418a5599e56e26 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:01.267825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:01.269243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.278784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:01.284064 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec006b08-a2bd-4616-a047-f3b6a3aeb3ab admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.288713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:01.290236 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.290522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.290798 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] PATH_INFO: `/v3/projects/bad226990fb84657895fd23285babf43` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.292005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad226990fb84657895fd23285babf43)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:01.293902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:01.360193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1307/2644] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:01 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:01.360193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69264f-904e-44c5-86d8-963838937eb3 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.360193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69264f-904e-44c5-86d8-963838937eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.360193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69264f-904e-44c5-86d8-963838937eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.377361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-3d69264f-904e-44c5-86d8-963838937eb3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:01.378602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3d69264f-904e-44c5-86d8-963838937eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.389068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1308/2645] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:01.389746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69264f-904e-44c5-86d8-963838937eb3 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:01.391094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-3d69264f-904e-44c5-86d8-963838937eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.404227 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69264f-904e-44c5-86d8-963838937eb3 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.416871 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad226990fb84657895fd23285babf43', 'request_id': 'req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.423513 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:01.467637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e5538-f24e-4ea8-a9c9-5fcf7e5ad9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:01.468311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5538-f24e-4ea8-a9c9-5fcf7e5ad9fe admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.468593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5538-f24e-4ea8-a9c9-5fcf7e5ad9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.468871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5538-f24e-4ea8-a9c9-5fcf7e5ad9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.469597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e5538-f24e-4ea8-a9c9-5fcf7e5ad9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:01.471277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e5538-f24e-4ea8-a9c9-5fcf7e5ad9fe admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:01.481473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1309/2646] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:01.482795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601119f-ab68-42b4-adda-b8a4714ab3a2 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.483087 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601119f-ab68-42b4-adda-b8a4714ab3a2 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.483362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601119f-ab68-42b4-adda-b8a4714ab3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.502115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6601119f-ab68-42b4-adda-b8a4714ab3a2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:01.503294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6601119f-ab68-42b4-adda-b8a4714ab3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.512206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1310/2647] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:01.513072 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601119f-ab68-42b4-adda-b8a4714ab3a2 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:01.515125 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad226990fb84657895fd23285babf43', 'request_id': 'req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.522522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad226990fb84657895fd23285babf43', 'request_id': 'req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.525735 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601119f-ab68-42b4-adda-b8a4714ab3a2 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.531037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d73de9-6a46-41ae-b95d-ccd1112373c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:01.533604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d73de9-6a46-41ae-b95d-ccd1112373c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.533604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d73de9-6a46-41ae-b95d-ccd1112373c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.533604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d73de9-6a46-41ae-b95d-ccd1112373c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.533604 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d73de9-6a46-41ae-b95d-ccd1112373c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:01.534782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d73de9-6a46-41ae-b95d-ccd1112373c4 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:01.535365 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] The token cache is being invalidate because project bad226990fb84657895fd23285babf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:01.535723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.536443 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.538426 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1338/2648] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:01 2022] DELETE /identity/v3/projects/bad226990fb84657895fd23285babf43 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:01.542165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:01.543553 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.545526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1311/2649] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:01.546443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d73de9-6a46-41ae-b95d-ccd1112373c4 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:01.550081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d7d73de9-6a46-41ae-b95d-ccd1112373c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.559250 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec513d-2dea-4fe4-a725-55ceda75dc7c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.562959 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d73de9-6a46-41ae-b95d-ccd1112373c4 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.564043 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:01.564818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.565113 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.565387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.566139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:58:01.566454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:01.567506 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:01.568127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:01.568479 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.568761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.569037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] PATH_INFO: `/v3/users/72b059821b0940f3a7129941923c6314` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.571470 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b059821b0940f3a7129941923c6314)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:01.572916 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:01.584262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1339/2650] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:58:01.584262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:01.585899 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.599611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92de9-7de4-42a8-926f-d4c4c2386ad8 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.604838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24088fec-944a-471c-8de8-dbf026bb0568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:01.605807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088fec-944a-471c-8de8-dbf026bb0568 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.606190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088fec-944a-471c-8de8-dbf026bb0568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.606496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088fec-944a-471c-8de8-dbf026bb0568 admin admin] PATH_INFO: `/v3/projects/a9a968ed3adc4f7bb769b1a209a8ac29/users/0e1f0ef8c6bb4850a5090eb6377fdfb2/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.623177 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24088fec-944a-471c-8de8-dbf026bb0568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a968ed3adc4f7bb769b1a209a8ac29, user_id=0e1f0ef8c6bb4850a5090eb6377fdfb2, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:01.625828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24088fec-944a-471c-8de8-dbf026bb0568 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:01.702850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1340/2651] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:01 2022] PUT /identity/v3/projects/a9a968ed3adc4f7bb769b1a209a8ac29/users/0e1f0ef8c6bb4850a5090eb6377fdfb2/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:01.703909 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24088fec-944a-471c-8de8-dbf026bb0568 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:01.705437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-24088fec-944a-471c-8de8-dbf026bb0568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.770255 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b059821b0940f3a7129941923c6314'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.771243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24088fec-944a-471c-8de8-dbf026bb0568 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.776942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:01.777865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:01.778199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:01.778483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] PATH_INFO: `/v3/projects/a3fcfe68e2634202b73d8fbb3a376063` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:01.779682 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fcfe68e2634202b73d8fbb3a376063)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:01.781649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:01.840821 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b059821b0940f3a7129941923c6314'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.841743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b059821b0940f3a7129941923c6314'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.854198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b059821b0940f3a7129941923c6314'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.854853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b059821b0940f3a7129941923c6314'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.866808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1312/2652] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:01 2022] DELETE /identity/v3/users/72b059821b0940f3a7129941923c6314 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:01.871768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:01.873886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:01.888350 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fcfe68e2634202b73d8fbb3a376063', 'request_id': 'req-2de68e95-01b8-4212-b49f-057e4b1280bf'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.939854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff7f1e-883d-450a-b7a1-cecdc8729cd0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:01.955574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:01.983670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fcfe68e2634202b73d8fbb3a376063', 'request_id': 'req-2de68e95-01b8-4212-b49f-057e4b1280bf'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:01.996194 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fcfe68e2634202b73d8fbb3a376063', 'request_id': 'req-2de68e95-01b8-4212-b49f-057e4b1280bf'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:02.000315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5f8b-9e4d-4827-9ebe-427b05a4ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.000315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5f8b-9e4d-4827-9ebe-427b05a4ffc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.000315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5f8b-9e4d-4827-9ebe-427b05a4ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.000315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5f8b-9e4d-4827-9ebe-427b05a4ffc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.000727 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c5f8b-9e4d-4827-9ebe-427b05a4ffc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.002601 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c5f8b-9e4d-4827-9ebe-427b05a4ffc2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.007108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] The token cache is being invalidate because project a3fcfe68e2634202b73d8fbb3a376063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:02.007477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:02.008793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-2de68e95-01b8-4212-b49f-057e4b1280bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:02.011175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1341/2653] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:01 2022] DELETE /identity/v3/projects/a3fcfe68e2634202b73d8fbb3a376063 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:02.012569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c0190-6130-4314-913b-947675bf32ed None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.013019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c0190-6130-4314-913b-947675bf32ed None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.013468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c0190-6130-4314-913b-947675bf32ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.041421 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-cd9c0190-6130-4314-913b-947675bf32ed None None] MFA Rules not processed for user `0e1f0ef8c6bb4850a5090eb6377fdfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:02.042697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cd9c0190-6130-4314-913b-947675bf32ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:02.047247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:02.111393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1342/2654] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:02.112809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61264e58-775b-428b-a7f3-a3619cd70ad3 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.113213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61264e58-775b-428b-a7f3-a3619cd70ad3 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.113632 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61264e58-775b-428b-a7f3-a3619cd70ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.118941 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1313/2655] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:01 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:02.128259 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5f8b-9e4d-4827-9ebe-427b05a4ffc2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.130316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b87c5f8b-9e4d-4827-9ebe-427b05a4ffc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:02.138902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-61264e58-775b-428b-a7f3-a3619cd70ad3 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:02.140096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-61264e58-775b-428b-a7f3-a3619cd70ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:02.203729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1343/2656] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:02.204263 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5f8b-9e4d-4827-9ebe-427b05a4ffc2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.204756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61264e58-775b-428b-a7f3-a3619cd70ad3 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.206168 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-61264e58-775b-428b-a7f3-a3619cd70ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:02.210238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17fae3-44c0-42ae-9067-f9581f75fd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.212693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17fae3-44c0-42ae-9067-f9581f75fd88 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.212998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17fae3-44c0-42ae-9067-f9581f75fd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.213285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17fae3-44c0-42ae-9067-f9581f75fd88 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.214017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17fae3-44c0-42ae-9067-f9581f75fd88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.215977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17fae3-44c0-42ae-9067-f9581f75fd88 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.265353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61264e58-775b-428b-a7f3-a3619cd70ad3 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.268927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fa368-75b3-4858-8529-acd70462c2f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.269579 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fa368-75b3-4858-8529-acd70462c2f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.269870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fa368-75b3-4858-8529-acd70462c2f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.270184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fa368-75b3-4858-8529-acd70462c2f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.325700 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fa368-75b3-4858-8529-acd70462c2f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.327176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fa368-75b3-4858-8529-acd70462c2f7 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.331294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1314/2657] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:02 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:58:02.332142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17fae3-44c0-42ae-9067-f9581f75fd88 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.333759 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6c17fae3-44c0-42ae-9067-f9581f75fd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:02.337717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1344/2658] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:02.339138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054f1f-4149-496f-9c23-612667eaa66e None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.339924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054f1f-4149-496f-9c23-612667eaa66e None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.340398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054f1f-4149-496f-9c23-612667eaa66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.348205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17fae3-44c0-42ae-9067-f9581f75fd88 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.353800 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.354817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.355111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.355394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] PATH_INFO: `/v3/projects/2be2fc55b7234b1fbd188718fd97fa02` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.356582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be2fc55b7234b1fbd188718fd97fa02)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.358328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-fa054f1f-4149-496f-9c23-612667eaa66e None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:02.358581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.359532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fa054f1f-4149-496f-9c23-612667eaa66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:02.367614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1345/2659] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:02.368864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054f1f-4149-496f-9c23-612667eaa66e None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.381852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054f1f-4149-496f-9c23-612667eaa66e None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.387468 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c77f8-8d18-4e07-9e04-a90d2b08abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.389112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c77f8-8d18-4e07-9e04-a90d2b08abe9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.389411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c77f8-8d18-4e07-9e04-a90d2b08abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.389692 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c77f8-8d18-4e07-9e04-a90d2b08abe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.390463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c77f8-8d18-4e07-9e04-a90d2b08abe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.397213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c77f8-8d18-4e07-9e04-a90d2b08abe9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.403000 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1346/2660] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:02.404108 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c77f8-8d18-4e07-9e04-a90d2b08abe9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.413864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c77f8-8d18-4e07-9e04-a90d2b08abe9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.419239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96f1d-1d71-4051-8371-5f7d32052d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.423706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96f1d-1d71-4051-8371-5f7d32052d47 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.423706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96f1d-1d71-4051-8371-5f7d32052d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.423706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96f1d-1d71-4051-8371-5f7d32052d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.423706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96f1d-1d71-4051-8371-5f7d32052d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:58:02.423706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96f1d-1d71-4051-8371-5f7d32052d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.423706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96f1d-1d71-4051-8371-5f7d32052d47 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.436016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1347/2661] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:58:02.436819 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96f1d-1d71-4051-8371-5f7d32052d47 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.447299 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96f1d-1d71-4051-8371-5f7d32052d47 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.451940 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569b66-b4ad-4cc3-a214-6b9ed8632aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.452581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569b66-b4ad-4cc3-a214-6b9ed8632aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.452862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569b66-b4ad-4cc3-a214-6b9ed8632aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.453136 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569b66-b4ad-4cc3-a214-6b9ed8632aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.453849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d569b66-b4ad-4cc3-a214-6b9ed8632aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.455461 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d569b66-b4ad-4cc3-a214-6b9ed8632aa0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.465889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1348/2662] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:02.466944 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569b66-b4ad-4cc3-a214-6b9ed8632aa0 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.477582 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569b66-b4ad-4cc3-a214-6b9ed8632aa0 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.490592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be2fc55b7234b1fbd188718fd97fa02', 'request_id': 'req-52f7a672-27b2-46ac-981b-004fd3f78b9e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:02.498803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be2fc55b7234b1fbd188718fd97fa02', 'request_id': 'req-52f7a672-27b2-46ac-981b-004fd3f78b9e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:02.533375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565669a6-09f1-4c7c-a4e5-d0c193481a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.534133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565669a6-09f1-4c7c-a4e5-d0c193481a5d admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.534420 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565669a6-09f1-4c7c-a4e5-d0c193481a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.534702 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565669a6-09f1-4c7c-a4e5-d0c193481a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.535383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565669a6-09f1-4c7c-a4e5-d0c193481a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.537328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565669a6-09f1-4c7c-a4e5-d0c193481a5d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.583898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be2fc55b7234b1fbd188718fd97fa02', 'request_id': 'req-52f7a672-27b2-46ac-981b-004fd3f78b9e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:02.584127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:02.595276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] The token cache is being invalidate because project 2be2fc55b7234b1fbd188718fd97fa02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:02.595563 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:02.596199 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:02.597753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1315/2663] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:02 2022] DELETE /identity/v3/projects/2be2fc55b7234b1fbd188718fd97fa02 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:02.610100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.610100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:02.613015 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a672-27b2-46ac-981b-004fd3f78b9e admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.618512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7973125-b70b-4bc4-a172-e728a6029c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.619512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973125-b70b-4bc4-a172-e728a6029c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.619795 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973125-b70b-4bc4-a172-e728a6029c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.620074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973125-b70b-4bc4-a172-e728a6029c10 admin admin] PATH_INFO: `/v3/projects/94b859da62dd48d887939bad199c925c/users/bb9f382492f54ab0b954037ecddd5d6f/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.637597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7973125-b70b-4bc4-a172-e728a6029c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b859da62dd48d887939bad199c925c, user_id=bb9f382492f54ab0b954037ecddd5d6f, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.640692 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7973125-b70b-4bc4-a172-e728a6029c10 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.678075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1349/2664] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:02 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:02.682962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565669a6-09f1-4c7c-a4e5-d0c193481a5d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.684782 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-565669a6-09f1-4c7c-a4e5-d0c193481a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:02.749425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1316/2665] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:02 2022] PUT /identity/v3/projects/94b859da62dd48d887939bad199c925c/users/bb9f382492f54ab0b954037ecddd5d6f/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:02.759668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565669a6-09f1-4c7c-a4e5-d0c193481a5d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.760996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978b46b-893c-48a9-9e85-3eb0fe65c789 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.761657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978b46b-893c-48a9-9e85-3eb0fe65c789 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.762118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978b46b-893c-48a9-9e85-3eb0fe65c789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.772141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:02.800246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-9978b46b-893c-48a9-9e85-3eb0fe65c789 None None] MFA Rules not processed for user `bb9f382492f54ab0b954037ecddd5d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:02.801480 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9978b46b-893c-48a9-9e85-3eb0fe65c789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:02.841149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03846fd3-9214-483a-9f5c-dd17a1a65a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.842602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03846fd3-9214-483a-9f5c-dd17a1a65a9b admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.843258 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03846fd3-9214-483a-9f5c-dd17a1a65a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.843767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03846fd3-9214-483a-9f5c-dd17a1a65a9b admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.844703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03846fd3-9214-483a-9f5c-dd17a1a65a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.850500 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03846fd3-9214-483a-9f5c-dd17a1a65a9b admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.876671 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1317/2666] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:58:02.881153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978b46b-893c-48a9-9e85-3eb0fe65c789 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.891335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978b46b-893c-48a9-9e85-3eb0fe65c789 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.895934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390c12d-377e-47a2-aa38-6cbf885b01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.896563 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390c12d-377e-47a2-aa38-6cbf885b01a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.896847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390c12d-377e-47a2-aa38-6cbf885b01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:02.897125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390c12d-377e-47a2-aa38-6cbf885b01a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:02.897806 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390c12d-377e-47a2-aa38-6cbf885b01a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:02.899808 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390c12d-377e-47a2-aa38-6cbf885b01a2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:02.977896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1350/2667] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:02 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:58:02.981882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03846fd3-9214-483a-9f5c-dd17a1a65a9b admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:02.991751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03846fd3-9214-483a-9f5c-dd17a1a65a9b admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:02.997230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce935ab-0425-4d98-942b-e39cebc4941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:02.998140 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce935ab-0425-4d98-942b-e39cebc4941d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:02.998295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce935ab-0425-4d98-942b-e39cebc4941d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.015926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce935ab-0425-4d98-942b-e39cebc4941d admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.015926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce935ab-0425-4d98-942b-e39cebc4941d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.015926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce935ab-0425-4d98-942b-e39cebc4941d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.016222 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1318/2668] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:02 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:58:03.016317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1351/2669] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:58:03.016782 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390c12d-377e-47a2-aa38-6cbf885b01a2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:03.017474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce935ab-0425-4d98-942b-e39cebc4941d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:03.027474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce935ab-0425-4d98-942b-e39cebc4941d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:03.078319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390c12d-377e-47a2-aa38-6cbf885b01a2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:03.082895 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d66a4c-2638-41ce-bb84-0a715f9669cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:03.083567 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d66a4c-2638-41ce-bb84-0a715f9669cc admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.083675 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71b598-0c9b-4a3b-8481-c0359a455a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:03.083833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d66a4c-2638-41ce-bb84-0a715f9669cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.084125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d66a4c-2638-41ce-bb84-0a715f9669cc admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.084295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71b598-0c9b-4a3b-8481-c0359a455a21 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.084586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71b598-0c9b-4a3b-8481-c0359a455a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.084815 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d66a4c-2638-41ce-bb84-0a715f9669cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.084911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71b598-0c9b-4a3b-8481-c0359a455a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.085596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71b598-0c9b-4a3b-8481-c0359a455a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.087028 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d66a4c-2638-41ce-bb84-0a715f9669cc admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.087257 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71b598-0c9b-4a3b-8481-c0359a455a21 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.101440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1352/2670] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:58:03.113716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71b598-0c9b-4a3b-8481-c0359a455a21 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:03.126307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71b598-0c9b-4a3b-8481-c0359a455a21 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:03.130972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fe72d-7bab-41bf-84d3-4abcfac37f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:03.132149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fe72d-7bab-41bf-84d3-4abcfac37f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.132437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fe72d-7bab-41bf-84d3-4abcfac37f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.132717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fe72d-7bab-41bf-84d3-4abcfac37f10 admin admin] PATH_INFO: `/v3/projects/e617d385153d4096a7e799a94f1ed616/users/b67c1659193a49e6b56e9a9eceb4cc15/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.148894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fe72d-7bab-41bf-84d3-4abcfac37f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e617d385153d4096a7e799a94f1ed616, user_id=b67c1659193a49e6b56e9a9eceb4cc15, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.153232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fe72d-7bab-41bf-84d3-4abcfac37f10 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.207211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1319/2671] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:03 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:03.211032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d66a4c-2638-41ce-bb84-0a715f9669cc admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:03.220958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d66a4c-2638-41ce-bb84-0a715f9669cc admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:03.225588 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3fe52-d2b3-462e-bd0b-833cf7f25fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:03.226257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3fe52-d2b3-462e-bd0b-833cf7f25fcc admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.226546 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3fe52-d2b3-462e-bd0b-833cf7f25fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.227354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3fe52-d2b3-462e-bd0b-833cf7f25fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.228243 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3fe52-d2b3-462e-bd0b-833cf7f25fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.229781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3fe52-d2b3-462e-bd0b-833cf7f25fcc admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.238395 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1353/2672] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:03 2022] PUT /identity/v3/projects/e617d385153d4096a7e799a94f1ed616/users/b67c1659193a49e6b56e9a9eceb4cc15/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:58:03.240314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1320/2673] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:58:03.244842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fe72d-7bab-41bf-84d3-4abcfac37f10 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:03.250532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941f68f-e51e-4c16-9518-078111fdffa4 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.250923 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941f68f-e51e-4c16-9518-078111fdffa4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.251232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941f68f-e51e-4c16-9518-078111fdffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.283313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-0941f68f-e51e-4c16-9518-078111fdffa4 None None] MFA Rules not processed for user `b67c1659193a49e6b56e9a9eceb4cc15`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:03.285319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-0941f68f-e51e-4c16-9518-078111fdffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:03.314055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fe72d-7bab-41bf-84d3-4abcfac37f10 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:03.318887 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb45b-65c6-474d-916a-542a6d4814ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:03.319867 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb45b-65c6-474d-916a-542a6d4814ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.320155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb45b-65c6-474d-916a-542a6d4814ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.320437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb45b-65c6-474d-916a-542a6d4814ca admin admin] PATH_INFO: `/v3/projects/8c2b93fde3b343fcacaea8356b2c94f1/users/b1e3222a97f74a438f4a1c6b33c74e49/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.335211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb45b-65c6-474d-916a-542a6d4814ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2b93fde3b343fcacaea8356b2c94f1, user_id=b1e3222a97f74a438f4a1c6b33c74e49, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.338583 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb45b-65c6-474d-916a-542a6d4814ca admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.350892 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1321/2674] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:58:03.364753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941f68f-e51e-4c16-9518-078111fdffa4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:03.364753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-0941f68f-e51e-4c16-9518-078111fdffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:03.420371 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941f68f-e51e-4c16-9518-078111fdffa4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:03.422976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1354/2675] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:03 2022] PUT /identity/v3/projects/8c2b93fde3b343fcacaea8356b2c94f1/users/b1e3222a97f74a438f4a1c6b33c74e49/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:58:03.426990 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb45b-65c6-474d-916a-542a6d4814ca admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:03.471656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976c933-cfb3-44b2-8275-fda01c86429b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:03.472457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976c933-cfb3-44b2-8275-fda01c86429b service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.472751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976c933-cfb3-44b2-8275-fda01c86429b service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.473038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976c933-cfb3-44b2-8275-fda01c86429b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.490835 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb45b-65c6-474d-916a-542a6d4814ca admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:03.494518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:03.497865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1cac4-6ffc-4164-972b-1240c2c831b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:03.508982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1cac4-6ffc-4164-972b-1240c2c831b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.508982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1cac4-6ffc-4164-972b-1240c2c831b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.508982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1cac4-6ffc-4164-972b-1240c2c831b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.508982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1cac4-6ffc-4164-972b-1240c2c831b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.508982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1cac4-6ffc-4164-972b-1240c2c831b9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.515591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1355/2676] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:58:03.516596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1cac4-6ffc-4164-972b-1240c2c831b9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:03.527825 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1cac4-6ffc-4164-972b-1240c2c831b9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:03.531655 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976c933-cfb3-44b2-8275-fda01c86429b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.537609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd198-a9dc-4c67-8e6a-39375bdc6ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:03.537753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976c933-cfb3-44b2-8275-fda01c86429b service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.537868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd198-a9dc-4c67-8e6a-39375bdc6ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.537868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd198-a9dc-4c67-8e6a-39375bdc6ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.537868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd198-a9dc-4c67-8e6a-39375bdc6ca5 admin admin] PATH_INFO: `/v3/projects/8c2b93fde3b343fcacaea8356b2c94f1/users/b1e3222a97f74a438f4a1c6b33c74e49/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.537868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fd198-a9dc-4c67-8e6a-39375bdc6ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2b93fde3b343fcacaea8356b2c94f1, user_id=b1e3222a97f74a438f4a1c6b33c74e49, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.539069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fd198-a9dc-4c67-8e6a-39375bdc6ca5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.543434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1322/2677] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:58:03.545285 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:03.550945 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1356/2678] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:03 2022] PUT /identity/v3/projects/8c2b93fde3b343fcacaea8356b2c94f1/users/b1e3222a97f74a438f4a1c6b33c74e49/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:03.562437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c5314-0554-4896-9558-a0adc3abcabc None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.562733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c5314-0554-4896-9558-a0adc3abcabc None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.563040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c5314-0554-4896-9558-a0adc3abcabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.590734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-582c5314-0554-4896-9558-a0adc3abcabc None None] MFA Rules not processed for user `b1e3222a97f74a438f4a1c6b33c74e49`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:03.592117 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-582c5314-0554-4896-9558-a0adc3abcabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:03.663228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1323/2679] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:03.674757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd198-a9dc-4c67-8e6a-39375bdc6ca5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:03.731491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:03.735251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd198-a9dc-4c67-8e6a-39375bdc6ca5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:03.739444 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab6dc8-adb9-4345-a019-3c2cae5e8aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:03.740097 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab6dc8-adb9-4345-a019-3c2cae5e8aaf service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:03.740385 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab6dc8-adb9-4345-a019-3c2cae5e8aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:03.740699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab6dc8-adb9-4345-a019-3c2cae5e8aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:03.749856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab6dc8-adb9-4345-a019-3c2cae5e8aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:03.751322 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab6dc8-adb9-4345-a019-3c2cae5e8aaf service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:03.761375 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1357/2680] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:03.811195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:04.003844 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c5314-0554-4896-9558-a0adc3abcabc None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:04.014443 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c5314-0554-4896-9558-a0adc3abcabc None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:04.017953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c99aa5-58e4-4532-ab20-680e991ecc7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:04.023314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c99aa5-58e4-4532-ab20-680e991ecc7f service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:04.023314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c99aa5-58e4-4532-ab20-680e991ecc7f service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:04.023314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c99aa5-58e4-4532-ab20-680e991ecc7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:04.075346 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c99aa5-58e4-4532-ab20-680e991ecc7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:04.076820 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c99aa5-58e4-4532-ab20-680e991ecc7f service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:04.086140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1324/2681] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:04.093007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:04.361815 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:06.484948 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab6dc8-adb9-4345-a019-3c2cae5e8aaf service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:06.486563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-26ab6dc8-adb9-4345-a019-3c2cae5e8aaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:06.506835 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:06.562656 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab6dc8-adb9-4345-a019-3c2cae5e8aaf service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:06.567404 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:06.568275 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:06.568559 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:06.568833 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] PATH_INFO: `/v3/users/0e1f0ef8c6bb4850a5090eb6377fdfb2` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:06.570040 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1f0ef8c6bb4850a5090eb6377fdfb2)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:06.572620 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:06.775331 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1f0ef8c6bb4850a5090eb6377fdfb2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:06.886469 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1f0ef8c6bb4850a5090eb6377fdfb2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:06.898870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1f0ef8c6bb4850a5090eb6377fdfb2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:06.899552 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1f0ef8c6bb4850a5090eb6377fdfb2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:06.906717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1f0ef8c6bb4850a5090eb6377fdfb2'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:06.912753 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1358/2682] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:06 2022] DELETE /identity/v3/users/0e1f0ef8c6bb4850a5090eb6377fdfb2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:06.917851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560881-f9bc-4bf2-9c04-7b40a1998dcf None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:06.918471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560881-f9bc-4bf2-9c04-7b40a1998dcf None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:06.918471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560881-f9bc-4bf2-9c04-7b40a1998dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:06.935947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-24560881-f9bc-4bf2-9c04-7b40a1998dcf None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:06.937112 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-24560881-f9bc-4bf2-9c04-7b40a1998dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:06.994715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1325/2683] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:07.004191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:07.005694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:07.063055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d94d3-1929-4502-82a7-aaec2b9be16f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:07.066651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79b1e-fdd0-4539-a1b9-54a08eea0651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:07.067298 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79b1e-fdd0-4539-a1b9-54a08eea0651 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:07.067586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79b1e-fdd0-4539-a1b9-54a08eea0651 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:07.067866 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79b1e-fdd0-4539-a1b9-54a08eea0651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:07.077578 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea79b1e-fdd0-4539-a1b9-54a08eea0651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:07.079134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea79b1e-fdd0-4539-a1b9-54a08eea0651 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:07.089529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1359/2684] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:07.486736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24560881-f9bc-4bf2-9c04-7b40a1998dcf None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:07.488766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-24560881-f9bc-4bf2-9c04-7b40a1998dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:07.501624 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24560881-f9bc-4bf2-9c04-7b40a1998dcf None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:07.506518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:07.507391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:07.507757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:07.508581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] PATH_INFO: `/v3/projects/a9a968ed3adc4f7bb769b1a209a8ac29` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:07.509807 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a968ed3adc4f7bb769b1a209a8ac29)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:07.511794 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:07.518828 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:07.703329 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a968ed3adc4f7bb769b1a209a8ac29', 'request_id': 'req-ef99f26b-183e-439a-839c-30ee5922c675'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:07.710306 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a968ed3adc4f7bb769b1a209a8ac29', 'request_id': 'req-ef99f26b-183e-439a-839c-30ee5922c675'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:07.777098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a968ed3adc4f7bb769b1a209a8ac29', 'request_id': 'req-ef99f26b-183e-439a-839c-30ee5922c675'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:07.793055 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] The token cache is being invalidate because project a9a968ed3adc4f7bb769b1a209a8ac29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:07.793055 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:07.793610 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ef99f26b-183e-439a-839c-30ee5922c675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:07.795695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1326/2685] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:07 2022] DELETE /identity/v3/projects/a9a968ed3adc4f7bb769b1a209a8ac29 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:07.800835 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e126da-bca9-4868-aa9c-4d4fe4bb921a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:07.801272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e126da-bca9-4868-aa9c-4d4fe4bb921a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:07.801532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e126da-bca9-4868-aa9c-4d4fe4bb921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:07.823217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-75e126da-bca9-4868-aa9c-4d4fe4bb921a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:07.824721 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-75e126da-bca9-4868-aa9c-4d4fe4bb921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:07.852143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:07.904528 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1360/2686] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:07.913491 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5e3c-f019-44ff-b0ef-3e2feefa4524 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:07.913882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5e3c-f019-44ff-b0ef-3e2feefa4524 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:07.914312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5e3c-f019-44ff-b0ef-3e2feefa4524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:07.933446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f7ab5e3c-f019-44ff-b0ef-3e2feefa4524 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:07.934774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f7ab5e3c-f019-44ff-b0ef-3e2feefa4524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:07.943477 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1327/2687] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:07.948031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e126da-bca9-4868-aa9c-4d4fe4bb921a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:07.959215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e126da-bca9-4868-aa9c-4d4fe4bb921a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:07.964133 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d4951-b693-42f8-8218-6f894b259f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:07.964830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d4951-b693-42f8-8218-6f894b259f21 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:07.965119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d4951-b693-42f8-8218-6f894b259f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:07.965402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d4951-b693-42f8-8218-6f894b259f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:07.966164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d4951-b693-42f8-8218-6f894b259f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:58:07.966746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d4951-b693-42f8-8218-6f894b259f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:07.968392 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d4951-b693-42f8-8218-6f894b259f21 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:07.981972 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1361/2688] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:58:07.986333 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab5e3c-f019-44ff-b0ef-3e2feefa4524 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:07.996548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab5e3c-f019-44ff-b0ef-3e2feefa4524 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:08.001246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b36b8d-a779-454a-b7ab-1059b844998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:08.001920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b36b8d-a779-454a-b7ab-1059b844998f admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:08.002245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b36b8d-a779-454a-b7ab-1059b844998f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:08.002530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b36b8d-a779-454a-b7ab-1059b844998f admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:08.003240 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b36b8d-a779-454a-b7ab-1059b844998f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:08.005154 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b36b8d-a779-454a-b7ab-1059b844998f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:08.106697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1328/2689] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:07 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:08.110865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d4951-b693-42f8-8218-6f894b259f21 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:08.121314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d4951-b693-42f8-8218-6f894b259f21 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:08.177353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f83a-27ce-4687-9587-741a9af8aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:08.178051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f83a-27ce-4687-9587-741a9af8aabf admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:08.178338 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f83a-27ce-4687-9587-741a9af8aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:08.178612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f83a-27ce-4687-9587-741a9af8aabf admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:08.179326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6f83a-27ce-4687-9587-741a9af8aabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:08.181798 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6f83a-27ce-4687-9587-741a9af8aabf admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:08.297999 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1362/2690] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:08 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:08.302048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b36b8d-a779-454a-b7ab-1059b844998f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:08.314461 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b36b8d-a779-454a-b7ab-1059b844998f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:08.319355 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251c120-470f-4200-bce0-ef8799ac5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:08.319995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251c120-470f-4200-bce0-ef8799ac5558 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:08.320288 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251c120-470f-4200-bce0-ef8799ac5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:08.320636 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251c120-470f-4200-bce0-ef8799ac5558 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:08.321419 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251c120-470f-4200-bce0-ef8799ac5558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:08.323096 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251c120-470f-4200-bce0-ef8799ac5558 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:08.337762 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1329/2691] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:08.341805 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f83a-27ce-4687-9587-741a9af8aabf admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:08.353826 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f83a-27ce-4687-9587-741a9af8aabf admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:08.359637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23d613-40e7-400b-a02f-ae9faf2c0559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:08.360516 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23d613-40e7-400b-a02f-ae9faf2c0559 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:08.360807 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23d613-40e7-400b-a02f-ae9faf2c0559 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:08.361170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23d613-40e7-400b-a02f-ae9faf2c0559 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:08.362939 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23d613-40e7-400b-a02f-ae9faf2c0559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:08.364928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23d613-40e7-400b-a02f-ae9faf2c0559 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:08.378492 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1363/2692] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:08.382757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251c120-470f-4200-bce0-ef8799ac5558 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:08.393502 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251c120-470f-4200-bce0-ef8799ac5558 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:08.398955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c46a64-efcc-4446-8f84-594d5caa55de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:08.399953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46a64-efcc-4446-8f84-594d5caa55de admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:08.400235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46a64-efcc-4446-8f84-594d5caa55de admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:08.400520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46a64-efcc-4446-8f84-594d5caa55de admin admin] PATH_INFO: `/v3/projects/cca4d2fc958849c3ba49718889ac9562/users/8986355fdc9d45aab0dd19bc5aa5a0d4/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:08.418221 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c46a64-efcc-4446-8f84-594d5caa55de admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca4d2fc958849c3ba49718889ac9562, user_id=8986355fdc9d45aab0dd19bc5aa5a0d4, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:08.420965 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c46a64-efcc-4446-8f84-594d5caa55de admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:08.498934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1330/2693] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:08 2022] PUT /identity/v3/projects/cca4d2fc958849c3ba49718889ac9562/users/8986355fdc9d45aab0dd19bc5aa5a0d4/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:08.503914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08b406-d422-4c48-8899-6d65088c507c None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:08.504208 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08b406-d422-4c48-8899-6d65088c507c None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:08.504484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08b406-d422-4c48-8899-6d65088c507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:08.521683 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-0c08b406-d422-4c48-8899-6d65088c507c None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:08.522921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0c08b406-d422-4c48-8899-6d65088c507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:08.581039 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1364/2694] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:08.591130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c46a64-efcc-4446-8f84-594d5caa55de admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:08.593134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f0c46a64-efcc-4446-8f84-594d5caa55de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:08.651099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c46a64-efcc-4446-8f84-594d5caa55de admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:08.654764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55739d02-687f-4bbb-b179-159ca70cd8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:08.655412 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739d02-687f-4bbb-b179-159ca70cd8ea service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:08.655693 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739d02-687f-4bbb-b179-159ca70cd8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:08.655968 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739d02-687f-4bbb-b179-159ca70cd8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:08.665500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55739d02-687f-4bbb-b179-159ca70cd8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:08.666947 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55739d02-687f-4bbb-b179-159ca70cd8ea service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:08.676279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1331/2695] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:09.917505 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523695d-5347-4f51-98e3-d95c31677f2a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:09.918063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523695d-5347-4f51-98e3-d95c31677f2a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:09.925153 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523695d-5347-4f51-98e3-d95c31677f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:09.972791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b523695d-5347-4f51-98e3-d95c31677f2a None None] MFA Rules not processed for user `8986355fdc9d45aab0dd19bc5aa5a0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:09.974671 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b523695d-5347-4f51-98e3-d95c31677f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:10.007289 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:10.060978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1365/2696] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:10.072850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55739d02-687f-4bbb-b179-159ca70cd8ea service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:10.074473 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-55739d02-687f-4bbb-b179-159ca70cd8ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:10.112186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:10.136351 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55739d02-687f-4bbb-b179-159ca70cd8ea service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:10.139977 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f52ca9-f337-45fd-878c-89df05c86b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:10.140668 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f52ca9-f337-45fd-878c-89df05c86b08 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:10.141165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f52ca9-f337-45fd-878c-89df05c86b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:10.141447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f52ca9-f337-45fd-878c-89df05c86b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:10.150530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f52ca9-f337-45fd-878c-89df05c86b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:10.152018 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f52ca9-f337-45fd-878c-89df05c86b08 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:10.161908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1332/2697] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:11.872286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288a593-1612-4742-98a6-f2816f70c1b2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:11.872778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288a593-1612-4742-98a6-f2816f70c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:11.872889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288a593-1612-4742-98a6-f2816f70c1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:11.892062 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-7288a593-1612-4742-98a6-f2816f70c1b2 None None] MFA Rules not processed for user `8986355fdc9d45aab0dd19bc5aa5a0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:11.893284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7288a593-1612-4742-98a6-f2816f70c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:11.900968 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1366/2698] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:12.135449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f52ca9-f337-45fd-878c-89df05c86b08 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:12.144768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f52ca9-f337-45fd-878c-89df05c86b08 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:12.148280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b3a78-d757-4fc8-b949-c3c0c6e546c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:12.149541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3a78-d757-4fc8-b949-c3c0c6e546c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:12.149826 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3a78-d757-4fc8-b949-c3c0c6e546c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:12.150134 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3a78-d757-4fc8-b949-c3c0c6e546c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:12.151852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-642b3a78-d757-4fc8-b949-c3c0c6e546c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:12.161237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b3a78-d757-4fc8-b949-c3c0c6e546c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:12.162676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b3a78-d757-4fc8-b949-c3c0c6e546c8 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:12.170653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1333/2699] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:12.863071 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288a593-1612-4742-98a6-f2816f70c1b2 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:12.864498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7288a593-1612-4742-98a6-f2816f70c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:12.878729 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288a593-1612-4742-98a6-f2816f70c1b2 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:12.883278 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:12.884143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:12.884428 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:12.884706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] PATH_INFO: `/v3/users/bb9f382492f54ab0b954037ecddd5d6f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:12.885886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9f382492f54ab0b954037ecddd5d6f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:12.887820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:13.109731 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9f382492f54ab0b954037ecddd5d6f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:13.189366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9f382492f54ab0b954037ecddd5d6f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:13.203427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9f382492f54ab0b954037ecddd5d6f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:13.203427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9f382492f54ab0b954037ecddd5d6f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:13.211852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9f382492f54ab0b954037ecddd5d6f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:13.218707 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1367/2700] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:12 2022] DELETE /identity/v3/users/bb9f382492f54ab0b954037ecddd5d6f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:13.223044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acdb87-4ca8-454c-b531-176ccf39cf96 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:13.223568 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acdb87-4ca8-454c-b531-176ccf39cf96 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:13.223798 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acdb87-4ca8-454c-b531-176ccf39cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:13.240648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e0acdb87-4ca8-454c-b531-176ccf39cf96 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:13.244688 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e0acdb87-4ca8-454c-b531-176ccf39cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:13.301047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1334/2701] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:13.311224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:13.312618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:13.373148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab361-43e8-4b77-a76c-d30ecd661c9d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:13.376765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48004697-7284-43c5-96b6-4018cc984975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:13.377393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48004697-7284-43c5-96b6-4018cc984975 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:13.377677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48004697-7284-43c5-96b6-4018cc984975 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:13.377982 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48004697-7284-43c5-96b6-4018cc984975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:13.388326 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48004697-7284-43c5-96b6-4018cc984975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:13.389860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48004697-7284-43c5-96b6-4018cc984975 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:13.399816 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1368/2702] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:13.846669 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acdb87-4ca8-454c-b531-176ccf39cf96 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:13.848110 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e0acdb87-4ca8-454c-b531-176ccf39cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:13.861393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acdb87-4ca8-454c-b531-176ccf39cf96 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:13.866237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:13.867165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:13.867447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:13.867732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] PATH_INFO: `/v3/projects/94b859da62dd48d887939bad199c925c` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:13.869262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b859da62dd48d887939bad199c925c)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:13.871260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:13.975095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b859da62dd48d887939bad199c925c', 'request_id': 'req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:13.981955 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b859da62dd48d887939bad199c925c', 'request_id': 'req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:14.087321 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b859da62dd48d887939bad199c925c', 'request_id': 'req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:14.105857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] The token cache is being invalidate because project 94b859da62dd48d887939bad199c925c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:14.106252 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:14.106857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:14.108643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1335/2703] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:13 2022] DELETE /identity/v3/projects/94b859da62dd48d887939bad199c925c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:14.112475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48004697-7284-43c5-96b6-4018cc984975 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:14.123976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48004697-7284-43c5-96b6-4018cc984975 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:14.163994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:14.191027 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:14.191902 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:14.192184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:14.192454 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] PATH_INFO: `/v3/users/b1e3222a97f74a438f4a1c6b33c74e49` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:14.193785 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e3222a97f74a438f4a1c6b33c74e49)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:14.196463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:14.418775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e3222a97f74a438f4a1c6b33c74e49'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:14.508491 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e3222a97f74a438f4a1c6b33c74e49'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:14.521143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e3222a97f74a438f4a1c6b33c74e49'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:14.521790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e3222a97f74a438f4a1c6b33c74e49'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:14.528815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e3222a97f74a438f4a1c6b33c74e49'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:14.534815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1369/2704] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:14 2022] DELETE /identity/v3/users/b1e3222a97f74a438f4a1c6b33c74e49 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:14.991540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:14.993743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:15.007935 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac8ded-b6bb-4565-b1ed-82a57ddb8b40 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:15.055949 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:15.070088 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:15.071004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.071290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.071582 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] PATH_INFO: `/v3/projects/8c2b93fde3b343fcacaea8356b2c94f1` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.072770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2b93fde3b343fcacaea8356b2c94f1)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:15.074785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:15.172759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:15.174327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:15.187843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15aee5-0d7f-4b50-8929-2b1f7ae873da admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:15.192511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:15.193527 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.193879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.194276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] PATH_INFO: `/v3/users/b67c1659193a49e6b56e9a9eceb4cc15` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.195528 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67c1659193a49e6b56e9a9eceb4cc15)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:15.197448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:15.228507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2b93fde3b343fcacaea8356b2c94f1', 'request_id': 'req-427f3d84-8426-4784-92df-b29106a4612a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.234880 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2b93fde3b343fcacaea8356b2c94f1', 'request_id': 'req-427f3d84-8426-4784-92df-b29106a4612a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.349726 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2b93fde3b343fcacaea8356b2c94f1', 'request_id': 'req-427f3d84-8426-4784-92df-b29106a4612a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.361650 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] The token cache is being invalidate because project 8c2b93fde3b343fcacaea8356b2c94f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:15.362111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.362938 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-427f3d84-8426-4784-92df-b29106a4612a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.364695 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1336/2705] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:14 2022] DELETE /identity/v3/projects/8c2b93fde3b343fcacaea8356b2c94f1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:15.369486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550997a1-302b-4f07-a866-05ac4fff4927 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.369785 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550997a1-302b-4f07-a866-05ac4fff4927 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.370121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550997a1-302b-4f07-a866-05ac4fff4927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.388437 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-550997a1-302b-4f07-a866-05ac4fff4927 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:15.389751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-550997a1-302b-4f07-a866-05ac4fff4927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:15.453445 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67c1659193a49e6b56e9a9eceb4cc15'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.460832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1337/2706] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:58:15.464305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf7b43-e079-4adc-ab26-78ae196c2bcc None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.464621 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf7b43-e079-4adc-ab26-78ae196c2bcc None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.466339 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf7b43-e079-4adc-ab26-78ae196c2bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.486181 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-d0bf7b43-e079-4adc-ab26-78ae196c2bcc None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:15.487294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d0bf7b43-e079-4adc-ab26-78ae196c2bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:15.495394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1338/2707] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:58:15.499452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf7b43-e079-4adc-ab26-78ae196c2bcc None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:15.508526 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf7b43-e079-4adc-ab26-78ae196c2bcc None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:15.513148 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa6f53-7e8c-47e9-9795-d05da96d587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:15.513797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa6f53-7e8c-47e9-9795-d05da96d587f admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.514146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa6f53-7e8c-47e9-9795-d05da96d587f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.514425 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa6f53-7e8c-47e9-9795-d05da96d587f admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.515647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa6f53-7e8c-47e9-9795-d05da96d587f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:58:15.515647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa6f53-7e8c-47e9-9795-d05da96d587f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:15.517056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa6f53-7e8c-47e9-9795-d05da96d587f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:15.529589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1339/2708] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:58:15.533878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa6f53-7e8c-47e9-9795-d05da96d587f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:15.544279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa6f53-7e8c-47e9-9795-d05da96d587f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:15.548160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67c1659193a49e6b56e9a9eceb4cc15'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.549076 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de1f7d-8967-421c-a276-db546690294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:15.549757 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de1f7d-8967-421c-a276-db546690294c admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.550079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de1f7d-8967-421c-a276-db546690294c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.550489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de1f7d-8967-421c-a276-db546690294c admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.551111 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de1f7d-8967-421c-a276-db546690294c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:15.553018 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de1f7d-8967-421c-a276-db546690294c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:15.562992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67c1659193a49e6b56e9a9eceb4cc15'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.563882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67c1659193a49e6b56e9a9eceb4cc15'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.571572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7ed9bfc9-6343-4d39-a3bc-5ab7a75498be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67c1659193a49e6b56e9a9eceb4cc15'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:15.578021 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1370/2709] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:15 2022] DELETE /identity/v3/users/b67c1659193a49e6b56e9a9eceb4cc15 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:58:15.582658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d357e-1ed2-4144-be1e-84e19f3c72a5 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.587356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d357e-1ed2-4144-be1e-84e19f3c72a5 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.587356 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d357e-1ed2-4144-be1e-84e19f3c72a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.600699 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-278d357e-1ed2-4144-be1e-84e19f3c72a5 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:15.602524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-278d357e-1ed2-4144-be1e-84e19f3c72a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:15.622977 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:15.643021 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1340/2710] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:15 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:58:15.644004 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de1f7d-8967-421c-a276-db546690294c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:15.645756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b5de1f7d-8967-421c-a276-db546690294c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:15.673111 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1371/2711] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:58:15.680615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d357e-1ed2-4144-be1e-84e19f3c72a5 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:15.682151 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-278d357e-1ed2-4144-be1e-84e19f3c72a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:15.688361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:15.713166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de1f7d-8967-421c-a276-db546690294c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:15.718365 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43c769-a1eb-4452-9701-adc9380103b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:15.719037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43c769-a1eb-4452-9701-adc9380103b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.719529 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43c769-a1eb-4452-9701-adc9380103b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.719803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43c769-a1eb-4452-9701-adc9380103b9 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.720492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43c769-a1eb-4452-9701-adc9380103b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:15.722530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43c769-a1eb-4452-9701-adc9380103b9 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:15.740911 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d357e-1ed2-4144-be1e-84e19f3c72a5 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:15.791930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf0378-8191-41f6-baa8-43001b32056a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:15.792579 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf0378-8191-41f6-baa8-43001b32056a service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.792868 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf0378-8191-41f6-baa8-43001b32056a service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.793295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf0378-8191-41f6-baa8-43001b32056a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.803243 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf0378-8191-41f6-baa8-43001b32056a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:15.805248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf0378-8191-41f6-baa8-43001b32056a service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:15.814996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1372/2712] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:15.842475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1341/2713] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:15 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:15.847403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf0378-8191-41f6-baa8-43001b32056a service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:15.858305 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf0378-8191-41f6-baa8-43001b32056a service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:15.863896 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6feb3-1147-4f0e-8a18-9b3860d94c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:15.864840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6feb3-1147-4f0e-8a18-9b3860d94c4d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.865148 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6feb3-1147-4f0e-8a18-9b3860d94c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.865427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6feb3-1147-4f0e-8a18-9b3860d94c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.868329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6feb3-1147-4f0e-8a18-9b3860d94c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:15.868524 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6feb3-1147-4f0e-8a18-9b3860d94c4d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:15.879219 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1373/2714] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:15.884238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43c769-a1eb-4452-9701-adc9380103b9 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:15.895635 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43c769-a1eb-4452-9701-adc9380103b9 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:15.902853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26c6bc-d43c-402c-84c2-e214db0126e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:15.903528 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c6bc-d43c-402c-84c2-e214db0126e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.903829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c6bc-d43c-402c-84c2-e214db0126e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.904098 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c6bc-d43c-402c-84c2-e214db0126e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.904839 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c6bc-d43c-402c-84c2-e214db0126e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:15.906519 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c6bc-d43c-402c-84c2-e214db0126e8 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:15.918658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1342/2715] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:15.922221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6feb3-1147-4f0e-8a18-9b3860d94c4d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:15.932313 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6feb3-1147-4f0e-8a18-9b3860d94c4d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:15.936976 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4506-0495-4729-9c7c-db9a6cb0e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:15.937858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4506-0495-4729-9c7c-db9a6cb0e464 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:15.938176 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4506-0495-4729-9c7c-db9a6cb0e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:15.938455 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4506-0495-4729-9c7c-db9a6cb0e464 admin admin] PATH_INFO: `/v3/projects/2ab764c2a8bb45248c4677cf1297f278/users/e98b2f2d23424d41a36079818e1b0695/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:15.954589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad4506-0495-4729-9c7c-db9a6cb0e464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab764c2a8bb45248c4677cf1297f278, user_id=e98b2f2d23424d41a36079818e1b0695, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:15.957264 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad4506-0495-4729-9c7c-db9a6cb0e464 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:16.035787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1374/2716] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:15 2022] PUT /identity/v3/projects/2ab764c2a8bb45248c4677cf1297f278/users/e98b2f2d23424d41a36079818e1b0695/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:16.046406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbbb18-637c-4738-bfc0-5dead713d972 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.047277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbbb18-637c-4738-bfc0-5dead713d972 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.047729 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbbb18-637c-4738-bfc0-5dead713d972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.085858 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-91cbbb18-637c-4738-bfc0-5dead713d972 None None] MFA Rules not processed for user `e98b2f2d23424d41a36079818e1b0695`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:16.087611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-91cbbb18-637c-4738-bfc0-5dead713d972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:16.161929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1343/2717] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:58:16.166645 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4506-0495-4729-9c7c-db9a6cb0e464 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:16.223577 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:16.237779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4506-0495-4729-9c7c-db9a6cb0e464 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:16.243411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad9e32-1986-4df0-ba3b-a58bda210b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:16.244271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9e32-1986-4df0-ba3b-a58bda210b66 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.244563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9e32-1986-4df0-ba3b-a58bda210b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.244849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9e32-1986-4df0-ba3b-a58bda210b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.245564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad9e32-1986-4df0-ba3b-a58bda210b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:16.247498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad9e32-1986-4df0-ba3b-a58bda210b66 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:16.306291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbbb18-637c-4738-bfc0-5dead713d972 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:16.307907 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-91cbbb18-637c-4738-bfc0-5dead713d972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:16.324638 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbbb18-637c-4738-bfc0-5dead713d972 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:16.331857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:16.331857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.331857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.331857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] PATH_INFO: `/v3/projects/e617d385153d4096a7e799a94f1ed616` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.333480 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e617d385153d4096a7e799a94f1ed616)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:16.335401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:16.348210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1375/2718] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:16 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:58:16.352834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad9e32-1986-4df0-ba3b-a58bda210b66 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:16.413996 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad9e32-1986-4df0-ba3b-a58bda210b66 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:16.419442 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcdb63-8422-4a23-b0b7-43b0315d92d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:16.420114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcdb63-8422-4a23-b0b7-43b0315d92d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.420402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcdb63-8422-4a23-b0b7-43b0315d92d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.420679 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcdb63-8422-4a23-b0b7-43b0315d92d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.421416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcdb63-8422-4a23-b0b7-43b0315d92d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:16.423541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcdb63-8422-4a23-b0b7-43b0315d92d1 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:16.456137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e617d385153d4096a7e799a94f1ed616', 'request_id': 'req-b5856f38-56df-4c6e-bf7f-85e0e0afa425'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:16.464090 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e617d385153d4096a7e799a94f1ed616', 'request_id': 'req-b5856f38-56df-4c6e-bf7f-85e0e0afa425'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:16.545229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e617d385153d4096a7e799a94f1ed616', 'request_id': 'req-b5856f38-56df-4c6e-bf7f-85e0e0afa425'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:16.553828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1376/2719] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:16 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:58:16.555476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcdb63-8422-4a23-b0b7-43b0315d92d1 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:16.558561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] The token cache is being invalidate because project e617d385153d4096a7e799a94f1ed616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:16.558856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:16.561087 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:16.563315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1344/2720] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:16 2022] DELETE /identity/v3/projects/e617d385153d4096a7e799a94f1ed616 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:16.566635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcdb63-8422-4a23-b0b7-43b0315d92d1 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:16.638137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144dd73-78e2-443d-aae1-8ec318cb19eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:16.638840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144dd73-78e2-443d-aae1-8ec318cb19eb admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.639130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144dd73-78e2-443d-aae1-8ec318cb19eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.639612 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144dd73-78e2-443d-aae1-8ec318cb19eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.640387 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144dd73-78e2-443d-aae1-8ec318cb19eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:16.642102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144dd73-78e2-443d-aae1-8ec318cb19eb admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:16.653446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1377/2721] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:58:16.657881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:16.659466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:16.674422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5856f38-56df-4c6e-bf7f-85e0e0afa425 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:16.679458 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd77aa5-fba8-4902-a73c-35eaf22f3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:16.681075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd77aa5-fba8-4902-a73c-35eaf22f3508 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.681429 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd77aa5-fba8-4902-a73c-35eaf22f3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.681803 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd77aa5-fba8-4902-a73c-35eaf22f3508 admin admin] PATH_INFO: `/v3/projects/8c4496c45199486aae791576cbd34902/users/8f8207d5067c443f968907faf48a3996/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.699208 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd77aa5-fba8-4902-a73c-35eaf22f3508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4496c45199486aae791576cbd34902, user_id=8f8207d5067c443f968907faf48a3996, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:16.701893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd77aa5-fba8-4902-a73c-35eaf22f3508 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:16.809426 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1345/2722] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:16 2022] PUT /identity/v3/projects/8c4496c45199486aae791576cbd34902/users/8f8207d5067c443f968907faf48a3996/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:16.812728 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144dd73-78e2-443d-aae1-8ec318cb19eb admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:16.824741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144dd73-78e2-443d-aae1-8ec318cb19eb admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:16.885847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73455457-0884-4f12-9067-f78e1f0f186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:16.886549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455457-0884-4f12-9067-f78e1f0f186f admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.886840 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455457-0884-4f12-9067-f78e1f0f186f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.887120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455457-0884-4f12-9067-f78e1f0f186f admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.888079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73455457-0884-4f12-9067-f78e1f0f186f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:16.889519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73455457-0884-4f12-9067-f78e1f0f186f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:16.891069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:16.903207 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1378/2723] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:16.907382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd77aa5-fba8-4902-a73c-35eaf22f3508 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:16.912878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:16.919131 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd77aa5-fba8-4902-a73c-35eaf22f3508 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:16.924295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869296af-ac53-4053-8f41-45d16a5581f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:16.925196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869296af-ac53-4053-8f41-45d16a5581f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.926155 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869296af-ac53-4053-8f41-45d16a5581f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.926449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869296af-ac53-4053-8f41-45d16a5581f6 admin admin] PATH_INFO: `/v3/projects/8c4496c45199486aae791576cbd34902/users/8f8207d5067c443f968907faf48a3996/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.928478 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869296af-ac53-4053-8f41-45d16a5581f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4496c45199486aae791576cbd34902, user_id=8f8207d5067c443f968907faf48a3996, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:16.931201 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869296af-ac53-4053-8f41-45d16a5581f6 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:16.941765 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1346/2724] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:16 2022] PUT /identity/v3/projects/8c4496c45199486aae791576cbd34902/users/8f8207d5067c443f968907faf48a3996/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:16.952993 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738f889-09f1-4331-9c55-da4c7c09df35 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.953287 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738f889-09f1-4331-9c55-da4c7c09df35 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.953581 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738f889-09f1-4331-9c55-da4c7c09df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.981324 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-2738f889-09f1-4331-9c55-da4c7c09df35 None None] MFA Rules not processed for user `8f8207d5067c443f968907faf48a3996`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:16.982642 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-2738f889-09f1-4331-9c55-da4c7c09df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:17.054591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1379/2725] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:17.065522 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869296af-ac53-4053-8f41-45d16a5581f6 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:17.067387 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-869296af-ac53-4053-8f41-45d16a5581f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:17.133422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869296af-ac53-4053-8f41-45d16a5581f6 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:17.138245 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f9187-578c-482e-896a-622fe8491920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:17.138899 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f9187-578c-482e-896a-622fe8491920 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:17.139188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f9187-578c-482e-896a-622fe8491920 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:17.139548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f9187-578c-482e-896a-622fe8491920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:17.141293 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f55f9187-578c-482e-896a-622fe8491920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:17.234873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f9187-578c-482e-896a-622fe8491920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:17.236480 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f9187-578c-482e-896a-622fe8491920 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:17.246853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1347/2726] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:20.434213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738f889-09f1-4331-9c55-da4c7c09df35 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:20.444102 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738f889-09f1-4331-9c55-da4c7c09df35 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:20.448441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455efd36-c0ed-42ef-b3e9-b7895c27ca00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:20.450212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455efd36-c0ed-42ef-b3e9-b7895c27ca00 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:20.450212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455efd36-c0ed-42ef-b3e9-b7895c27ca00 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:20.450212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455efd36-c0ed-42ef-b3e9-b7895c27ca00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:20.458929 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455efd36-c0ed-42ef-b3e9-b7895c27ca00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:20.460367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455efd36-c0ed-42ef-b3e9-b7895c27ca00 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:20.470953 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1380/2727] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:27.243039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:30.466363 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=42 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:35.119579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f9187-578c-482e-896a-622fe8491920 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:35.181816 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f9187-578c-482e-896a-622fe8491920 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:35.186256 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:35.187115 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:35.187427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:35.187701 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] PATH_INFO: `/v3/users/e98b2f2d23424d41a36079818e1b0695` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:35.188868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98b2f2d23424d41a36079818e1b0695)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:35.190801 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:35.378789 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98b2f2d23424d41a36079818e1b0695'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:35.486238 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98b2f2d23424d41a36079818e1b0695'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:35.486866 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98b2f2d23424d41a36079818e1b0695'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:35.499804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98b2f2d23424d41a36079818e1b0695'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:35.500453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98b2f2d23424d41a36079818e1b0695'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:35.512552 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1348/2728] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:35 2022] DELETE /identity/v3/users/e98b2f2d23424d41a36079818e1b0695 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:35.517076 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89072bb6-6acb-40b6-9307-02ed7622e79f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:35.517564 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89072bb6-6acb-40b6-9307-02ed7622e79f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:35.517669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89072bb6-6acb-40b6-9307-02ed7622e79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:35.537477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-89072bb6-6acb-40b6-9307-02ed7622e79f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:35.538732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-89072bb6-6acb-40b6-9307-02ed7622e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:35.606766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1381/2729] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:35.616323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:35.617773 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:35.675290 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198747a3-ccb8-4b0e-ab7f-962776c935fa admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:35.679476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05220be-b175-418d-9450-d8d25bc5c8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:35.680105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05220be-b175-418d-9450-d8d25bc5c8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:35.680392 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05220be-b175-418d-9450-d8d25bc5c8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:35.680673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05220be-b175-418d-9450-d8d25bc5c8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:35.689847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05220be-b175-418d-9450-d8d25bc5c8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:35.691303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05220be-b175-418d-9450-d8d25bc5c8b0 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:35.701063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1349/2730] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:36.104251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89072bb6-6acb-40b6-9307-02ed7622e79f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:36.105079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-89072bb6-6acb-40b6-9307-02ed7622e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:36.117765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89072bb6-6acb-40b6-9307-02ed7622e79f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:36.122864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:36.123716 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:36.124005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:36.124291 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] PATH_INFO: `/v3/projects/2ab764c2a8bb45248c4677cf1297f278` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:36.125522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab764c2a8bb45248c4677cf1297f278)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:36.127593 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:36.259741 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab764c2a8bb45248c4677cf1297f278', 'request_id': 'req-5f97c32f-1dce-4d57-9099-8f3d19b6364d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.338211 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab764c2a8bb45248c4677cf1297f278', 'request_id': 'req-5f97c32f-1dce-4d57-9099-8f3d19b6364d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.345254 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab764c2a8bb45248c4677cf1297f278', 'request_id': 'req-5f97c32f-1dce-4d57-9099-8f3d19b6364d'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.356413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] The token cache is being invalidate because project 2ab764c2a8bb45248c4677cf1297f278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:36.356712 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.357339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.358907 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1382/2731] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:36 2022] DELETE /identity/v3/projects/2ab764c2a8bb45248c4677cf1297f278 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:36.362841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05220be-b175-418d-9450-d8d25bc5c8b0 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:36.372482 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05220be-b175-418d-9450-d8d25bc5c8b0 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:36.390141 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:36.427434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:36.428312 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:36.428602 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:36.428890 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] PATH_INFO: `/v3/users/8f8207d5067c443f968907faf48a3996` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:36.430142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8207d5067c443f968907faf48a3996)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:36.432149 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:36.604352 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8207d5067c443f968907faf48a3996'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.675710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8207d5067c443f968907faf48a3996'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.676326 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8207d5067c443f968907faf48a3996'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.695954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8207d5067c443f968907faf48a3996'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.696709 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1f78d826-1599-49b2-b1ec-d2fc378786b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8207d5067c443f968907faf48a3996'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:36.708833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1350/2732] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:36 2022] DELETE /identity/v3/users/8f8207d5067c443f968907faf48a3996 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:37.099477 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:37.100897 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:37.117335 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97c32f-1dce-4d57-9099-8f3d19b6364d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:37.175677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:37.176584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.176870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.177180 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] PATH_INFO: `/v3/projects/8c4496c45199486aae791576cbd34902` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:37.178400 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4496c45199486aae791576cbd34902)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:37.180340 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:37.265080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:37.281251 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4496c45199486aae791576cbd34902', 'request_id': 'req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:37.332127 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4496c45199486aae791576cbd34902', 'request_id': 'req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:37.339514 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4496c45199486aae791576cbd34902', 'request_id': 'req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:37.350603 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] The token cache is being invalidate because project 8c4496c45199486aae791576cbd34902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:37.350833 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:37.352077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3e63cb80-0c16-4cf0-8e4c-790cf0c1e8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:37.353611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1383/2733] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:37 2022] DELETE /identity/v3/projects/8c4496c45199486aae791576cbd34902 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:37.358556 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39b88-cead-4ccd-b336-3f8537938b50 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.358857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39b88-cead-4ccd-b336-3f8537938b50 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.359158 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39b88-cead-4ccd-b336-3f8537938b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:37.376583 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-fcc39b88-cead-4ccd-b336-3f8537938b50 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:37.377784 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-fcc39b88-cead-4ccd-b336-3f8537938b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:37.438094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1351/2734] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:37.446475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb66260-9bfa-45fe-9601-fb4bbd4a722a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.446756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb66260-9bfa-45fe-9601-fb4bbd4a722a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.447036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb66260-9bfa-45fe-9601-fb4bbd4a722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:37.465921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-0fb66260-9bfa-45fe-9601-fb4bbd4a722a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:37.467399 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0fb66260-9bfa-45fe-9601-fb4bbd4a722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:37.475370 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1384/2735] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:37.479390 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc39b88-cead-4ccd-b336-3f8537938b50 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:37.489101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc39b88-cead-4ccd-b336-3f8537938b50 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:37.493716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d1753-b6c3-4214-a838-7f6b445e889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:37.494422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d1753-b6c3-4214-a838-7f6b445e889f admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.494710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d1753-b6c3-4214-a838-7f6b445e889f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.494993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d1753-b6c3-4214-a838-7f6b445e889f admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:37.495717 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d1753-b6c3-4214-a838-7f6b445e889f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:58:37.496030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d1753-b6c3-4214-a838-7f6b445e889f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:37.497643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d1753-b6c3-4214-a838-7f6b445e889f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:37.510215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1352/2736] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:58:37.514452 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb66260-9bfa-45fe-9601-fb4bbd4a722a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:37.524237 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb66260-9bfa-45fe-9601-fb4bbd4a722a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:37.528791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444a544-a252-4a83-9d5e-5fca7e60fca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:37.529435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444a544-a252-4a83-9d5e-5fca7e60fca9 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.529724 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444a544-a252-4a83-9d5e-5fca7e60fca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.530055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444a544-a252-4a83-9d5e-5fca7e60fca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:37.533307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444a544-a252-4a83-9d5e-5fca7e60fca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:37.533307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444a544-a252-4a83-9d5e-5fca7e60fca9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:37.625751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1385/2737] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:37 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:37.629983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d1753-b6c3-4214-a838-7f6b445e889f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:37.640420 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d1753-b6c3-4214-a838-7f6b445e889f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:37.668000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:37.699119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a344bb8-4853-412e-9cb3-697ce9b4b3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:37.699787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344bb8-4853-412e-9cb3-697ce9b4b3ba admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.700075 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344bb8-4853-412e-9cb3-697ce9b4b3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.700360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344bb8-4853-412e-9cb3-697ce9b4b3ba admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:37.701039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a344bb8-4853-412e-9cb3-697ce9b4b3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:37.702994 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a344bb8-4853-412e-9cb3-697ce9b4b3ba admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:37.787496 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1353/2738] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:37 2022] POST /identity/v3/users => generated 301 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:37.792314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444a544-a252-4a83-9d5e-5fca7e60fca9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:37.802675 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444a544-a252-4a83-9d5e-5fca7e60fca9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:37.807403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ac93-2b29-401c-82a9-c493eb33113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:37.808063 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ac93-2b29-401c-82a9-c493eb33113e admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.808351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ac93-2b29-401c-82a9-c493eb33113e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.808630 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ac93-2b29-401c-82a9-c493eb33113e admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:37.809360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495ac93-2b29-401c-82a9-c493eb33113e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:37.811120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495ac93-2b29-401c-82a9-c493eb33113e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:37.821434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1386/2739] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:37.825208 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a344bb8-4853-412e-9cb3-697ce9b4b3ba admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:37.835199 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a344bb8-4853-412e-9cb3-697ce9b4b3ba admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:37.840309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f029113-6ecc-456a-861f-52561b567e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:37.840958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029113-6ecc-456a-861f-52561b567e95 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.841247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029113-6ecc-456a-861f-52561b567e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.841548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029113-6ecc-456a-861f-52561b567e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:37.842552 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f029113-6ecc-456a-861f-52561b567e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:37.844135 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f029113-6ecc-456a-861f-52561b567e95 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:37.854822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1354/2740] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:37.858611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ac93-2b29-401c-82a9-c493eb33113e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:37.868447 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ac93-2b29-401c-82a9-c493eb33113e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:37.872988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b462a03-0bce-4cea-b1b4-b09f0808e145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:37.873787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b462a03-0bce-4cea-b1b4-b09f0808e145 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.874112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b462a03-0bce-4cea-b1b4-b09f0808e145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.874389 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b462a03-0bce-4cea-b1b4-b09f0808e145 admin admin] PATH_INFO: `/v3/projects/e951b184e9484c9b89cef069b4ed7089/users/a3c455f3629c4b10bee9592ce05175c7/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:37.888438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b462a03-0bce-4cea-b1b4-b09f0808e145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e951b184e9484c9b89cef069b4ed7089, user_id=a3c455f3629c4b10bee9592ce05175c7, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:37.891116 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b462a03-0bce-4cea-b1b4-b09f0808e145 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:37.972920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1387/2741] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:37 2022] PUT /identity/v3/projects/e951b184e9484c9b89cef069b4ed7089/users/a3c455f3629c4b10bee9592ce05175c7/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:37.985049 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70089fcb-6e29-44ad-8390-7df91273ae70 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:37.985368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70089fcb-6e29-44ad-8390-7df91273ae70 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:37.985653 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70089fcb-6e29-44ad-8390-7df91273ae70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:38.012196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-70089fcb-6e29-44ad-8390-7df91273ae70 None None] MFA Rules not processed for user `a3c455f3629c4b10bee9592ce05175c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:38.013405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-70089fcb-6e29-44ad-8390-7df91273ae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:38.077456 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1355/2742] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:38.081863 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b462a03-0bce-4cea-b1b4-b09f0808e145 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:38.144584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b462a03-0bce-4cea-b1b4-b09f0808e145 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:38.149798 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddfe93-2833-4159-9efb-38c8a424841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:38.150471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddfe93-2833-4159-9efb-38c8a424841c admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:38.150778 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddfe93-2833-4159-9efb-38c8a424841c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:38.151032 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddfe93-2833-4159-9efb-38c8a424841c admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:38.151723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddfe93-2833-4159-9efb-38c8a424841c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:38.153637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddfe93-2833-4159-9efb-38c8a424841c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:38.253478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1388/2743] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:38 2022] POST /identity/v3/projects => generated 401 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:38.258137 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70089fcb-6e29-44ad-8390-7df91273ae70 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:38.269379 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70089fcb-6e29-44ad-8390-7df91273ae70 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:38.325455 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14508f9a-b3ac-4ab9-aebe-c5016c4bd33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:38.326260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14508f9a-b3ac-4ab9-aebe-c5016c4bd33f admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:38.326548 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14508f9a-b3ac-4ab9-aebe-c5016c4bd33f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:38.326830 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14508f9a-b3ac-4ab9-aebe-c5016c4bd33f admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:38.327517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14508f9a-b3ac-4ab9-aebe-c5016c4bd33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:38.329435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14508f9a-b3ac-4ab9-aebe-c5016c4bd33f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:38.422428 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1356/2744] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:38 2022] POST /identity/v3/users => generated 307 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:58:38.426430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddfe93-2833-4159-9efb-38c8a424841c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:38.436584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddfe93-2833-4159-9efb-38c8a424841c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:38.441157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92adc4-b084-469b-90b0-ba83c4e45a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:38.441812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92adc4-b084-469b-90b0-ba83c4e45a0d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:38.442155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92adc4-b084-469b-90b0-ba83c4e45a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:38.442437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92adc4-b084-469b-90b0-ba83c4e45a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:38.443170 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92adc4-b084-469b-90b0-ba83c4e45a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:38.445535 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92adc4-b084-469b-90b0-ba83c4e45a0d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:38.455888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1389/2745] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:38.459985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14508f9a-b3ac-4ab9-aebe-c5016c4bd33f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:38.470769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14508f9a-b3ac-4ab9-aebe-c5016c4bd33f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:38.475417 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae6c8-de5f-4773-966e-9733289ad522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:38.476294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae6c8-de5f-4773-966e-9733289ad522 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:38.476579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae6c8-de5f-4773-966e-9733289ad522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:38.476853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae6c8-de5f-4773-966e-9733289ad522 admin admin] PATH_INFO: `/v3/projects/3464c33e60ca4b08bebacb6c81a08f3e/users/08807c9ae70f4df6a81c49b0e0421b07/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:38.491278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae6c8-de5f-4773-966e-9733289ad522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3464c33e60ca4b08bebacb6c81a08f3e, user_id=08807c9ae70f4df6a81c49b0e0421b07, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:38.495394 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae6c8-de5f-4773-966e-9733289ad522 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:38.572979 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1357/2746] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:38 2022] PUT /identity/v3/projects/3464c33e60ca4b08bebacb6c81a08f3e/users/08807c9ae70f4df6a81c49b0e0421b07/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:38.576932 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92adc4-b084-469b-90b0-ba83c4e45a0d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:38.586890 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92adc4-b084-469b-90b0-ba83c4e45a0d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:38.606670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:38.643652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a30424-8c20-4d68-872e-df7292c555b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:38.644658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a30424-8c20-4d68-872e-df7292c555b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:38.644658 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a30424-8c20-4d68-872e-df7292c555b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:38.644860 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a30424-8c20-4d68-872e-df7292c555b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:38.645567 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a30424-8c20-4d68-872e-df7292c555b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:38.647197 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a30424-8c20-4d68-872e-df7292c555b3 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:38.656791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1390/2747] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:38.660939 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae6c8-de5f-4773-966e-9733289ad522 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:38.666730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:38.673733 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae6c8-de5f-4773-966e-9733289ad522 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:38.677928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441bbd-5467-4f7e-a213-8715bd9121e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:38.678882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441bbd-5467-4f7e-a213-8715bd9121e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:38.679734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441bbd-5467-4f7e-a213-8715bd9121e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:38.680022 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441bbd-5467-4f7e-a213-8715bd9121e0 admin admin] PATH_INFO: `/v3/projects/3464c33e60ca4b08bebacb6c81a08f3e/users/08807c9ae70f4df6a81c49b0e0421b07/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:38.682009 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26441bbd-5467-4f7e-a213-8715bd9121e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3464c33e60ca4b08bebacb6c81a08f3e, user_id=08807c9ae70f4df6a81c49b0e0421b07, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:38.684672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26441bbd-5467-4f7e-a213-8715bd9121e0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:38.696976 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1358/2748] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:38 2022] PUT /identity/v3/projects/3464c33e60ca4b08bebacb6c81a08f3e/users/08807c9ae70f4df6a81c49b0e0421b07/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:38.707290 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747621b2-21dd-4bd6-bbb7-f457cb6922cb None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:38.707591 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747621b2-21dd-4bd6-bbb7-f457cb6922cb None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:38.707927 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747621b2-21dd-4bd6-bbb7-f457cb6922cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:38.735367 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-747621b2-21dd-4bd6-bbb7-f457cb6922cb None None] MFA Rules not processed for user `08807c9ae70f4df6a81c49b0e0421b07`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:38.736560 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-747621b2-21dd-4bd6-bbb7-f457cb6922cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:38.803450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1391/2749] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:38.814823 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441bbd-5467-4f7e-a213-8715bd9121e0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:38.819183 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-26441bbd-5467-4f7e-a213-8715bd9121e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:38.875799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441bbd-5467-4f7e-a213-8715bd9121e0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:38.879466 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dbe63-aea7-4ef3-a337-c41f4b4bf8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:38.880114 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dbe63-aea7-4ef3-a337-c41f4b4bf8cd service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:38.880401 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dbe63-aea7-4ef3-a337-c41f4b4bf8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:38.880682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dbe63-aea7-4ef3-a337-c41f4b4bf8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:38.889673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dbe63-aea7-4ef3-a337-c41f4b4bf8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:38.891138 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dbe63-aea7-4ef3-a337-c41f4b4bf8cd service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:38.901464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1359/2750] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:38 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:39.123179 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747621b2-21dd-4bd6-bbb7-f457cb6922cb None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:39.124596 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-747621b2-21dd-4bd6-bbb7-f457cb6922cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:39.136606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747621b2-21dd-4bd6-bbb7-f457cb6922cb None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:39.140134 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af276fd-749f-4eb7-9f90-53ffb3986463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:39.140764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af276fd-749f-4eb7-9f90-53ffb3986463 service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:39.141049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af276fd-749f-4eb7-9f90-53ffb3986463 service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:39.141328 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af276fd-749f-4eb7-9f90-53ffb3986463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:39.197496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af276fd-749f-4eb7-9f90-53ffb3986463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:39.199019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af276fd-749f-4eb7-9f90-53ffb3986463 service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:39.208005 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1392/2751] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:42.819226 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346b911-ae98-4492-b3be-d8bb86d36817 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:42.820269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346b911-ae98-4492-b3be-d8bb86d36817 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:42.820269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346b911-ae98-4492-b3be-d8bb86d36817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:42.838166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c346b911-ae98-4492-b3be-d8bb86d36817 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:42.845157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c346b911-ae98-4492-b3be-d8bb86d36817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:42.901999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1360/2752] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:42.919956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af276fd-749f-4eb7-9f90-53ffb3986463 service cinder] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:42.920568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7af276fd-749f-4eb7-9f90-53ffb3986463 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:42.974821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:43.001783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af276fd-749f-4eb7-9f90-53ffb3986463 service cinder] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:43.007938 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92ef98-c07c-4ca3-82c6-48bb85cdcf8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:43.008607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92ef98-c07c-4ca3-82c6-48bb85cdcf8f service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:43.008898 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92ef98-c07c-4ca3-82c6-48bb85cdcf8f service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:43.009192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92ef98-c07c-4ca3-82c6-48bb85cdcf8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:43.017351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92ef98-c07c-4ca3-82c6-48bb85cdcf8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:43.018956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92ef98-c07c-4ca3-82c6-48bb85cdcf8f service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:43.028358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1393/2753] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:44.261399 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346b911-ae98-4492-b3be-d8bb86d36817 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:44.271039 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346b911-ae98-4492-b3be-d8bb86d36817 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:44.275486 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:44.276354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:44.276654 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:44.276930 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] PATH_INFO: `/v3/users/a3c455f3629c4b10bee9592ce05175c7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:44.278161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c455f3629c4b10bee9592ce05175c7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:44.280102 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:44.457985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c455f3629c4b10bee9592ce05175c7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:44.549595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c455f3629c4b10bee9592ce05175c7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:44.550278 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c455f3629c4b10bee9592ce05175c7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:44.563766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c455f3629c4b10bee9592ce05175c7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:44.564860 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c455f3629c4b10bee9592ce05175c7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:44.576577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1361/2754] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:44 2022] DELETE /identity/v3/users/a3c455f3629c4b10bee9592ce05175c7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:44.581210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a91ee-cdf9-4111-be4c-11e744325d6a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:44.581690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a91ee-cdf9-4111-be4c-11e744325d6a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:44.581786 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a91ee-cdf9-4111-be4c-11e744325d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:44.599268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-463a91ee-cdf9-4111-be4c-11e744325d6a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:44.600456 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-463a91ee-cdf9-4111-be4c-11e744325d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:44.662670 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1394/2755] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:44.674929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:44.676411 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:44.685025 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:44.736608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad7a0f-f7b8-413a-9fd2-9c3f70d8896f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:44.740206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632ee00-afae-40f7-9cfb-6301ef0f875a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:44.740888 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632ee00-afae-40f7-9cfb-6301ef0f875a service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:44.741229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632ee00-afae-40f7-9cfb-6301ef0f875a service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:44.741512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632ee00-afae-40f7-9cfb-6301ef0f875a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:44.750677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632ee00-afae-40f7-9cfb-6301ef0f875a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:44.752109 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632ee00-afae-40f7-9cfb-6301ef0f875a service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:44.761551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1362/2756] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:45.149414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a91ee-cdf9-4111-be4c-11e744325d6a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:45.150875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-463a91ee-cdf9-4111-be4c-11e744325d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:45.163163 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a91ee-cdf9-4111-be4c-11e744325d6a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:45.167754 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:45.168696 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:45.168993 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:45.169269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] PATH_INFO: `/v3/projects/e951b184e9484c9b89cef069b4ed7089` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:45.170521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e951b184e9484c9b89cef069b4ed7089)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:45.172448 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:45.308827 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e951b184e9484c9b89cef069b4ed7089', 'request_id': 'req-c7c4d565-a7e6-4477-adb1-4973a97f1001'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.393109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e951b184e9484c9b89cef069b4ed7089', 'request_id': 'req-c7c4d565-a7e6-4477-adb1-4973a97f1001'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.399611 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e951b184e9484c9b89cef069b4ed7089', 'request_id': 'req-c7c4d565-a7e6-4477-adb1-4973a97f1001'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.410233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] The token cache is being invalidate because project e951b184e9484c9b89cef069b4ed7089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:45.410530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.411193 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.412781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1395/2757] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:45 2022] DELETE /identity/v3/projects/e951b184e9484c9b89cef069b4ed7089 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:45.416876 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632ee00-afae-40f7-9cfb-6301ef0f875a service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:45.426539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632ee00-afae-40f7-9cfb-6301ef0f875a service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:45.483017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:45.483879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:45.484161 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:45.484438 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] PATH_INFO: `/v3/users/08807c9ae70f4df6a81c49b0e0421b07` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:45.485605 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08807c9ae70f4df6a81c49b0e0421b07)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:45.487559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:45.729311 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08807c9ae70f4df6a81c49b0e0421b07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.811924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08807c9ae70f4df6a81c49b0e0421b07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.812561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08807c9ae70f4df6a81c49b0e0421b07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.825045 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08807c9ae70f4df6a81c49b0e0421b07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.825682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-1072a4a7-5bf7-4d57-8540-f5af855dda96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08807c9ae70f4df6a81c49b0e0421b07'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:45.837747 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1363/2758] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:45 2022] DELETE /identity/v3/users/08807c9ae70f4df6a81c49b0e0421b07 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:46.259823 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:46.261308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:46.275252 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4d565-a7e6-4477-adb1-4973a97f1001 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:46.325056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:46.335223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:46.335223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:46.335223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:46.335223 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] PATH_INFO: `/v3/projects/3464c33e60ca4b08bebacb6c81a08f3e` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:46.336479 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3464c33e60ca4b08bebacb6c81a08f3e)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:46.338504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:46.457173 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3464c33e60ca4b08bebacb6c81a08f3e', 'request_id': 'req-e7539a54-2a30-49c8-a803-109daf2c5978'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:46.635401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3464c33e60ca4b08bebacb6c81a08f3e', 'request_id': 'req-e7539a54-2a30-49c8-a803-109daf2c5978'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:46.642232 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3464c33e60ca4b08bebacb6c81a08f3e', 'request_id': 'req-e7539a54-2a30-49c8-a803-109daf2c5978'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:46.653052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] The token cache is being invalidate because project 3464c33e60ca4b08bebacb6c81a08f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:46.653401 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:46.654080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-e7539a54-2a30-49c8-a803-109daf2c5978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:46.655680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1396/2759] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:46 2022] DELETE /identity/v3/projects/3464c33e60ca4b08bebacb6c81a08f3e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:58:46.660521 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d497e4-81ff-42bf-93b3-962834c24bee None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:46.660984 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d497e4-81ff-42bf-93b3-962834c24bee None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:46.661095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d497e4-81ff-42bf-93b3-962834c24bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:46.678833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-03d497e4-81ff-42bf-93b3-962834c24bee None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:46.680676 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-03d497e4-81ff-42bf-93b3-962834c24bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:46.701294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:46.739865 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1364/2760] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:46.748351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6bccb-a10c-465b-afa1-771fcd0fc13b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:46.748649 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6bccb-a10c-465b-afa1-771fcd0fc13b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:46.749075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6bccb-a10c-465b-afa1-771fcd0fc13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:46.767427 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-aed6bccb-a10c-465b-afa1-771fcd0fc13b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:46.768688 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-aed6bccb-a10c-465b-afa1-771fcd0fc13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:46.779525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1397/2761] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:46.783769 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d497e4-81ff-42bf-93b3-962834c24bee None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:46.794139 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d497e4-81ff-42bf-93b3-962834c24bee None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:46.798796 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c480-f924-4d07-a06c-25f6678c9a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:46.799459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c480-f924-4d07-a06c-25f6678c9a5e admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:46.799750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c480-f924-4d07-a06c-25f6678c9a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:46.800034 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c480-f924-4d07-a06c-25f6678c9a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:46.800778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189c480-f924-4d07-a06c-25f6678c9a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:58:46.801094 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189c480-f924-4d07-a06c-25f6678c9a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:46.802753 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189c480-f924-4d07-a06c-25f6678c9a5e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:46.814410 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1365/2762] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:58:46.818767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6bccb-a10c-465b-afa1-771fcd0fc13b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:46.828643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6bccb-a10c-465b-afa1-771fcd0fc13b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:46.833233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294de6b-8cc6-4b5b-bf35-750de0e1740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:46.833921 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294de6b-8cc6-4b5b-bf35-750de0e1740a admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:46.834239 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294de6b-8cc6-4b5b-bf35-750de0e1740a admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:46.834517 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294de6b-8cc6-4b5b-bf35-750de0e1740a admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:46.835216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294de6b-8cc6-4b5b-bf35-750de0e1740a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:46.837618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294de6b-8cc6-4b5b-bf35-750de0e1740a admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:46.941028 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1398/2763] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:46 2022] POST /identity/v3/projects => generated 409 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:46.945196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c480-f924-4d07-a06c-25f6678c9a5e admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:46.955536 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c480-f924-4d07-a06c-25f6678c9a5e admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.013099 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30630ed1-b511-4408-8506-6beaf0f4bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.017463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30630ed1-b511-4408-8506-6beaf0f4bccd admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.017463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30630ed1-b511-4408-8506-6beaf0f4bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.017463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30630ed1-b511-4408-8506-6beaf0f4bccd admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.017463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30630ed1-b511-4408-8506-6beaf0f4bccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.017463 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30630ed1-b511-4408-8506-6beaf0f4bccd admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.110317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1366/2764] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:46 2022] POST /identity/v3/users => generated 305 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:47.114506 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294de6b-8cc6-4b5b-bf35-750de0e1740a admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.125003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294de6b-8cc6-4b5b-bf35-750de0e1740a admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.129830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53328c-613a-4854-83a2-27f9dfe5cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.130563 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53328c-613a-4854-83a2-27f9dfe5cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.130855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53328c-613a-4854-83a2-27f9dfe5cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.132962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53328c-613a-4854-83a2-27f9dfe5cc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.132962 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53328c-613a-4854-83a2-27f9dfe5cc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.134016 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53328c-613a-4854-83a2-27f9dfe5cc40 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.145549 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1399/2765] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:47.150035 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30630ed1-b511-4408-8506-6beaf0f4bccd admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.160174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30630ed1-b511-4408-8506-6beaf0f4bccd admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.164742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1db0-d536-4b3b-9fbf-118ef2270c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.165440 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1db0-d536-4b3b-9fbf-118ef2270c29 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.165723 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1db0-d536-4b3b-9fbf-118ef2270c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.166032 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1db0-d536-4b3b-9fbf-118ef2270c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.166756 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1db0-d536-4b3b-9fbf-118ef2270c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.168337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1db0-d536-4b3b-9fbf-118ef2270c29 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.178538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1367/2766] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:47.184139 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53328c-613a-4854-83a2-27f9dfe5cc40 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.190683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb89bdb-d0ae-49ed-bc56-843ef81c50ec None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.190980 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb89bdb-d0ae-49ed-bc56-843ef81c50ec None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.191262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb89bdb-d0ae-49ed-bc56-843ef81c50ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.192865 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53328c-613a-4854-83a2-27f9dfe5cc40 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.198260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aae5ad-c30b-4483-91da-3102b25149d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.199971 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aae5ad-c30b-4483-91da-3102b25149d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.200260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aae5ad-c30b-4483-91da-3102b25149d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.200542 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aae5ad-c30b-4483-91da-3102b25149d5 admin admin] PATH_INFO: `/v3/projects/7c9e5d62e51c4e31be7282d905c0169d/users/49870187cdaf47f99d36884ef977a5db/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.210171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-deb89bdb-d0ae-49ed-bc56-843ef81c50ec None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:47.212017 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-deb89bdb-d0ae-49ed-bc56-843ef81c50ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:47.217373 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aae5ad-c30b-4483-91da-3102b25149d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9e5d62e51c4e31be7282d905c0169d, user_id=49870187cdaf47f99d36884ef977a5db, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.220065 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aae5ad-c30b-4483-91da-3102b25149d5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.220391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1368/2767] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:58:47.235436 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb89bdb-d0ae-49ed-bc56-843ef81c50ec None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.236849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-deb89bdb-d0ae-49ed-bc56-843ef81c50ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:47.307783 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb89bdb-d0ae-49ed-bc56-843ef81c50ec None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.337119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1400/2768] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:47 2022] PUT /identity/v3/projects/7c9e5d62e51c4e31be7282d905c0169d/users/49870187cdaf47f99d36884ef977a5db/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:47.337700 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000f0fe-4b90-4d80-a55f-7e087fd1401b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.338179 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000f0fe-4b90-4d80-a55f-7e087fd1401b service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.338471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000f0fe-4b90-4d80-a55f-7e087fd1401b service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.338755 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000f0fe-4b90-4d80-a55f-7e087fd1401b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.348893 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600d084-c6cd-4ba2-b76e-d60d7415e108 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.349187 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600d084-c6cd-4ba2-b76e-d60d7415e108 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.349471 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600d084-c6cd-4ba2-b76e-d60d7415e108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.352673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000f0fe-4b90-4d80-a55f-7e087fd1401b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.354319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000f0fe-4b90-4d80-a55f-7e087fd1401b service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.364494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1369/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:58:47.375521 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-0600d084-c6cd-4ba2-b76e-d60d7415e108 None None] MFA Rules not processed for user `49870187cdaf47f99d36884ef977a5db`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:47.376766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0600d084-c6cd-4ba2-b76e-d60d7415e108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:47.442041 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1401/2770] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:58:47.447315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000f0fe-4b90-4d80-a55f-7e087fd1401b service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.458197 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000f0fe-4b90-4d80-a55f-7e087fd1401b service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.467431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:47.518475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56989d81-78ad-46a1-b77e-57c10b082f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.519166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56989d81-78ad-46a1-b77e-57c10b082f96 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.519454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56989d81-78ad-46a1-b77e-57c10b082f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.519738 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56989d81-78ad-46a1-b77e-57c10b082f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.520424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56989d81-78ad-46a1-b77e-57c10b082f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.522509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56989d81-78ad-46a1-b77e-57c10b082f96 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.594673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1370/2771] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:47 2022] POST /identity/v3/projects => generated 407 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:47.598571 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600d084-c6cd-4ba2-b76e-d60d7415e108 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.609519 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600d084-c6cd-4ba2-b76e-d60d7415e108 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.614112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:47.664924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69456aa6-52bd-4cd2-8d18-39b3437f4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.665499 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69456aa6-52bd-4cd2-8d18-39b3437f4d03 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.665787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69456aa6-52bd-4cd2-8d18-39b3437f4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.666112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69456aa6-52bd-4cd2-8d18-39b3437f4d03 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.666796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69456aa6-52bd-4cd2-8d18-39b3437f4d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.668745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69456aa6-52bd-4cd2-8d18-39b3437f4d03 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.756175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1402/2772] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:47 2022] POST /identity/v3/users => generated 310 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:47.759174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56989d81-78ad-46a1-b77e-57c10b082f96 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.769367 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56989d81-78ad-46a1-b77e-57c10b082f96 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.774077 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc656cc-8b77-4688-8387-53e0f2e4b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.774741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc656cc-8b77-4688-8387-53e0f2e4b60e admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.775030 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc656cc-8b77-4688-8387-53e0f2e4b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.775314 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc656cc-8b77-4688-8387-53e0f2e4b60e admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.776040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc656cc-8b77-4688-8387-53e0f2e4b60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.777680 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc656cc-8b77-4688-8387-53e0f2e4b60e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.788360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1371/2773] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:47.792355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69456aa6-52bd-4cd2-8d18-39b3437f4d03 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.802334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69456aa6-52bd-4cd2-8d18-39b3437f4d03 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.807507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c028-a90d-4074-bcaa-40674aa3b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.808382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c028-a90d-4074-bcaa-40674aa3b504 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.808669 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c028-a90d-4074-bcaa-40674aa3b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.808975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c028-a90d-4074-bcaa-40674aa3b504 admin admin] PATH_INFO: `/v3/projects/bc521fe4e7874a91b6d0a254492c35db/users/31a02a05de454eeb8e3c98128dcac41f/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.828726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835c028-a90d-4074-bcaa-40674aa3b504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc521fe4e7874a91b6d0a254492c35db, user_id=31a02a05de454eeb8e3c98128dcac41f, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.831434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835c028-a90d-4074-bcaa-40674aa3b504 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.898135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1403/2774] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:47 2022] PUT /identity/v3/projects/bc521fe4e7874a91b6d0a254492c35db/users/31a02a05de454eeb8e3c98128dcac41f/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:47.902142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc656cc-8b77-4688-8387-53e0f2e4b60e admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.912338 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc656cc-8b77-4688-8387-53e0f2e4b60e admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:47.967449 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ec66-a16b-406b-aaaa-85f2e4d3dcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:47.968023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ec66-a16b-406b-aaaa-85f2e4d3dcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:47.968305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ec66-a16b-406b-aaaa-85f2e4d3dcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:47.968581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ec66-a16b-406b-aaaa-85f2e4d3dcc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:47.969305 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74ec66-a16b-406b-aaaa-85f2e4d3dcc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:47.970925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74ec66-a16b-406b-aaaa-85f2e4d3dcc1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:47.980951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1372/2775] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:47.985060 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c028-a90d-4074-bcaa-40674aa3b504 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:47.995961 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c028-a90d-4074-bcaa-40674aa3b504 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:48.000783 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93515748-9098-4937-8c4d-3a65d4a462b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:48.001723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93515748-9098-4937-8c4d-3a65d4a462b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:48.002056 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93515748-9098-4937-8c4d-3a65d4a462b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:48.002344 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93515748-9098-4937-8c4d-3a65d4a462b2 admin admin] PATH_INFO: `/v3/projects/bc521fe4e7874a91b6d0a254492c35db/users/31a02a05de454eeb8e3c98128dcac41f/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:48.004310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93515748-9098-4937-8c4d-3a65d4a462b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc521fe4e7874a91b6d0a254492c35db, user_id=31a02a05de454eeb8e3c98128dcac41f, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:48.007008 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93515748-9098-4937-8c4d-3a65d4a462b2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:48.017169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1404/2776] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:47 2022] PUT /identity/v3/projects/bc521fe4e7874a91b6d0a254492c35db/users/31a02a05de454eeb8e3c98128dcac41f/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:48.027167 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156d92e-5447-4cfb-b2a4-2a874c8b3540 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:48.027467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156d92e-5447-4cfb-b2a4-2a874c8b3540 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:48.027752 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156d92e-5447-4cfb-b2a4-2a874c8b3540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:48.053719 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-1156d92e-5447-4cfb-b2a4-2a874c8b3540 None None] MFA Rules not processed for user `31a02a05de454eeb8e3c98128dcac41f`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:48.055570 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-1156d92e-5447-4cfb-b2a4-2a874c8b3540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:48.121742 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1373/2777] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:48.132336 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93515748-9098-4937-8c4d-3a65d4a462b2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:48.134045 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-93515748-9098-4937-8c4d-3a65d4a462b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:48.190606 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93515748-9098-4937-8c4d-3a65d4a462b2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:48.194353 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe326cf4-b3f3-4cd9-8f08-17359d05485f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:48.195019 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326cf4-b3f3-4cd9-8f08-17359d05485f service cinder] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:48.195309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326cf4-b3f3-4cd9-8f08-17359d05485f service cinder] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:48.195589 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326cf4-b3f3-4cd9-8f08-17359d05485f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:48.204809 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe326cf4-b3f3-4cd9-8f08-17359d05485f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:48.206284 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe326cf4-b3f3-4cd9-8f08-17359d05485f service cinder] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:48.216023 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1405/2778] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:48.533509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156d92e-5447-4cfb-b2a4-2a874c8b3540 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:48.543708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156d92e-5447-4cfb-b2a4-2a874c8b3540 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:48.547276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad8f9-6119-4590-9687-508a3dff91a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:48.547916 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad8f9-6119-4590-9687-508a3dff91a6 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:48.548207 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad8f9-6119-4590-9687-508a3dff91a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:48.548489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad8f9-6119-4590-9687-508a3dff91a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:48.552595 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:48.606328 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ad8f9-6119-4590-9687-508a3dff91a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:48.607884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ad8f9-6119-4590-9687-508a3dff91a6 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:48.617186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1374/2779] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:50.589508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824e57-e0c8-4f13-91c4-1d878890e2d2 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:50.590055 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824e57-e0c8-4f13-91c4-1d878890e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:50.590155 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824e57-e0c8-4f13-91c4-1d878890e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:50.609539 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-14824e57-e0c8-4f13-91c4-1d878890e2d2 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:50.610771 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-14824e57-e0c8-4f13-91c4-1d878890e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:50.671417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1406/2780] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:50.686648 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad8f9-6119-4590-9687-508a3dff91a6 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:50.688196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-787ad8f9-6119-4590-9687-508a3dff91a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:50.770071 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad8f9-6119-4590-9687-508a3dff91a6 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:50.776146 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d1bf7-98d7-4db5-9bf7-8db9a3880420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:50.776819 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d1bf7-98d7-4db5-9bf7-8db9a3880420 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:50.777082 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d1bf7-98d7-4db5-9bf7-8db9a3880420 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:50.777364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d1bf7-98d7-4db5-9bf7-8db9a3880420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:50.785670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d1bf7-98d7-4db5-9bf7-8db9a3880420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:50.787313 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d1bf7-98d7-4db5-9bf7-8db9a3880420 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:50.797358 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1375/2781] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:53.489764 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00417-bd74-4640-854b-6a5d6fafea59 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:53.490271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00417-bd74-4640-854b-6a5d6fafea59 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:53.490732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00417-bd74-4640-854b-6a5d6fafea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:53.498031 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:53.509437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-d8b00417-bd74-4640-854b-6a5d6fafea59 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:53.510740 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d8b00417-bd74-4640-854b-6a5d6fafea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:53.518937 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1407/2782] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:53.534286 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d1bf7-98d7-4db5-9bf7-8db9a3880420 service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:53.545969 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d1bf7-98d7-4db5-9bf7-8db9a3880420 service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:53.551361 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502331d-4566-4776-90ae-68d33ee265ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:53.551996 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502331d-4566-4776-90ae-68d33ee265ba service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:53.552280 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502331d-4566-4776-90ae-68d33ee265ba service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:53.552561 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502331d-4566-4776-90ae-68d33ee265ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:53.560673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502331d-4566-4776-90ae-68d33ee265ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:53.562277 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502331d-4566-4776-90ae-68d33ee265ba service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:53.571658 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1376/2783] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:55.299917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b00417-bd74-4640-854b-6a5d6fafea59 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:55.310137 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b00417-bd74-4640-854b-6a5d6fafea59 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:55.314817 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:55.315681 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:55.315967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:55.316245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] PATH_INFO: `/v3/users/49870187cdaf47f99d36884ef977a5db` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:55.317432 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=49870187cdaf47f99d36884ef977a5db)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:55.319388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:55.494744 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49870187cdaf47f99d36884ef977a5db'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:55.577674 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49870187cdaf47f99d36884ef977a5db'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:55.590154 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49870187cdaf47f99d36884ef977a5db'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:55.590798 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49870187cdaf47f99d36884ef977a5db'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:55.598080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49870187cdaf47f99d36884ef977a5db'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:55.604586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1408/2784] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:55 2022] DELETE /identity/v3/users/49870187cdaf47f99d36884ef977a5db => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:55.609176 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d30426-2088-43a6-bf5c-44420beb4be6 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:55.609652 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d30426-2088-43a6-bf5c-44420beb4be6 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:55.609768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d30426-2088-43a6-bf5c-44420beb4be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:55.627151 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-c4d30426-2088-43a6-bf5c-44420beb4be6 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:55.628424 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c4d30426-2088-43a6-bf5c-44420beb4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:55.688354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1377/2785] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:55.698026 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:55.699423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:55.756934 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8d0c5-eef3-4c50-95a7-57176c2edcbf admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:55.760487 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f16c3e-73ce-4978-91a0-9c5f6ee964d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:55.761135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f16c3e-73ce-4978-91a0-9c5f6ee964d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:55.761418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f16c3e-73ce-4978-91a0-9c5f6ee964d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:55.761697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f16c3e-73ce-4978-91a0-9c5f6ee964d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:55.770652 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f16c3e-73ce-4978-91a0-9c5f6ee964d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:55.772085 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f16c3e-73ce-4978-91a0-9c5f6ee964d7 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:55.782465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1409/2786] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:56.194673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d30426-2088-43a6-bf5c-44420beb4be6 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:56.196761 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-c4d30426-2088-43a6-bf5c-44420beb4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:56.215068 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d30426-2088-43a6-bf5c-44420beb4be6 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:56.220377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:56.221164 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:56.221460 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:56.221721 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] PATH_INFO: `/v3/projects/7c9e5d62e51c4e31be7282d905c0169d` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:56.222948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9e5d62e51c4e31be7282d905c0169d)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:56.224867 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:56.236579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=100 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:56.344195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9e5d62e51c4e31be7282d905c0169d', 'request_id': 'req-8bef742e-c68d-4765-bb14-11660d9c2fc7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.350467 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9e5d62e51c4e31be7282d905c0169d', 'request_id': 'req-8bef742e-c68d-4765-bb14-11660d9c2fc7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.426986 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9e5d62e51c4e31be7282d905c0169d', 'request_id': 'req-8bef742e-c68d-4765-bb14-11660d9c2fc7'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.438089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] The token cache is being invalidate because project 7c9e5d62e51c4e31be7282d905c0169d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:56.438377 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.438995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-8bef742e-c68d-4765-bb14-11660d9c2fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.440751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1378/2787] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:56 2022] DELETE /identity/v3/projects/7c9e5d62e51c4e31be7282d905c0169d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:56.444900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f16c3e-73ce-4978-91a0-9c5f6ee964d7 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:56.455238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f16c3e-73ce-4978-91a0-9c5f6ee964d7 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:56.512355 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:56.513222 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:56.513509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:56.513790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] PATH_INFO: `/v3/users/31a02a05de454eeb8e3c98128dcac41f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:56.515006 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a02a05de454eeb8e3c98128dcac41f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:56.516949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:56.531035 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:56.683703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a02a05de454eeb8e3c98128dcac41f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.712532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfc1e-cfa7-424e-bd08-cdd1525e7edb None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:56.713037 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfc1e-cfa7-424e-bd08-cdd1525e7edb None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:56.713136 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfc1e-cfa7-424e-bd08-cdd1525e7edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:56.731319 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ececfc1e-cfa7-424e-bd08-cdd1525e7edb None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:56.732492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ececfc1e-cfa7-424e-bd08-cdd1525e7edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:56.735656 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a02a05de454eeb8e3c98128dcac41f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.740324 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1379/2788] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:58:56.749489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a02a05de454eeb8e3c98128dcac41f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.750297 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a02a05de454eeb8e3c98128dcac41f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.756789 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececfc1e-cfa7-424e-bd08-cdd1525e7edb None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:56.757760 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a02a05de454eeb8e3c98128dcac41f'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:56.758196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ececfc1e-cfa7-424e-bd08-cdd1525e7edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:56.764572 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1410/2789] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:58:56 2022] DELETE /identity/v3/users/31a02a05de454eeb8e3c98128dcac41f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:56.835033 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececfc1e-cfa7-424e-bd08-cdd1525e7edb None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:56.897716 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6c4a9-6c3a-4cf1-b1b7-c091dfc3711f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:56.898403 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6c4a9-6c3a-4cf1-b1b7-c091dfc3711f service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:56.898691 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6c4a9-6c3a-4cf1-b1b7-c091dfc3711f service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:56.898983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6c4a9-6c3a-4cf1-b1b7-c091dfc3711f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:56.900734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-58b6c4a9-6c3a-4cf1-b1b7-c091dfc3711f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:56.932577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:56.965156 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6c4a9-6c3a-4cf1-b1b7-c091dfc3711f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:56.966812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6c4a9-6c3a-4cf1-b1b7-c091dfc3711f service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:56.977673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1380/2790] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:58:57.185882 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:57.187359 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:57.202613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f112c-b4c8-4675-8932-dd212625ff0c admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:57.209354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:57.209354 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:57.210075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:57.210075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] PATH_INFO: `/v3/projects/bc521fe4e7874a91b6d0a254492c35db` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:57.211301 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc521fe4e7874a91b6d0a254492c35db)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:57.213751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:57.344956 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc521fe4e7874a91b6d0a254492c35db', 'request_id': 'req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:57.423912 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc521fe4e7874a91b6d0a254492c35db', 'request_id': 'req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:57.430843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc521fe4e7874a91b6d0a254492c35db', 'request_id': 'req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:57.441717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] The token cache is being invalidate because project bc521fe4e7874a91b6d0a254492c35db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:58:57.442048 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:57.442690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-b5b62cc1-4aa9-4c5d-8898-1a6c105ae198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:58:57.444218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1411/2791] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:58:57 2022] DELETE /identity/v3/projects/bc521fe4e7874a91b6d0a254492c35db => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:57.449279 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b4c9e-75e2-43c7-a083-a1dabffce159 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:57.450951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b4c9e-75e2-43c7-a083-a1dabffce159 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:57.450951 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b4c9e-75e2-43c7-a083-a1dabffce159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:57.468140 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-8a6b4c9e-75e2-43c7-a083-a1dabffce159 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:57.469336 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-8a6b4c9e-75e2-43c7-a083-a1dabffce159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:57.528873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1381/2792] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:57.537684 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6bdd7-ed71-4291-bd6f-8d4e0a7cfd79 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:57.538221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6bdd7-ed71-4291-bd6f-8d4e0a7cfd79 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:57.538332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6bdd7-ed71-4291-bd6f-8d4e0a7cfd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:57.556849 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-69a6bdd7-ed71-4291-bd6f-8d4e0a7cfd79 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:57.558092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-69a6bdd7-ed71-4291-bd6f-8d4e0a7cfd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:57.565829 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1412/2793] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:57.569913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b4c9e-75e2-43c7-a083-a1dabffce159 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:57.579997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b4c9e-75e2-43c7-a083-a1dabffce159 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:57.584518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83115b21-f0e2-4d9d-b98b-8598394e1946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:57.585168 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83115b21-f0e2-4d9d-b98b-8598394e1946 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:57.585457 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83115b21-f0e2-4d9d-b98b-8598394e1946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:57.585741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83115b21-f0e2-4d9d-b98b-8598394e1946 admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:57.586520 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83115b21-f0e2-4d9d-b98b-8598394e1946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:58:57.586835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83115b21-f0e2-4d9d-b98b-8598394e1946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:57.589043 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83115b21-f0e2-4d9d-b98b-8598394e1946 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:57.601065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1382/2794] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:58:57.604978 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6bdd7-ed71-4291-bd6f-8d4e0a7cfd79 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:57.614234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6bdd7-ed71-4291-bd6f-8d4e0a7cfd79 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:57.618886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5ed4d-11a1-423b-a43b-a1afd83b91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:57.619525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ed4d-11a1-423b-a43b-a1afd83b91ad admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:57.619811 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ed4d-11a1-423b-a43b-a1afd83b91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:57.620092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ed4d-11a1-423b-a43b-a1afd83b91ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:57.620788 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5ed4d-11a1-423b-a43b-a1afd83b91ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:57.622733 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5ed4d-11a1-423b-a43b-a1afd83b91ad admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:57.722587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1413/2795] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:57 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:57.726673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83115b21-f0e2-4d9d-b98b-8598394e1946 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:57.736845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83115b21-f0e2-4d9d-b98b-8598394e1946 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:57.792963 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737cff5-7260-4f5c-b1de-4d405ae5d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:57.793632 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737cff5-7260-4f5c-b1de-4d405ae5d3af admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:57.793924 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737cff5-7260-4f5c-b1de-4d405ae5d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:57.794235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737cff5-7260-4f5c-b1de-4d405ae5d3af admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:57.794936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737cff5-7260-4f5c-b1de-4d405ae5d3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:57.796852 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737cff5-7260-4f5c-b1de-4d405ae5d3af admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:57.872961 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1383/2796] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:57 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:58:57.877162 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5ed4d-11a1-423b-a43b-a1afd83b91ad admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:57.888047 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5ed4d-11a1-423b-a43b-a1afd83b91ad admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:57.892813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42e9c1-57a9-47aa-9740-9d507b3b63da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:57.893476 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42e9c1-57a9-47aa-9740-9d507b3b63da admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:57.893759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42e9c1-57a9-47aa-9740-9d507b3b63da admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:57.894144 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42e9c1-57a9-47aa-9740-9d507b3b63da admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:57.894876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42e9c1-57a9-47aa-9740-9d507b3b63da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:57.896512 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42e9c1-57a9-47aa-9740-9d507b3b63da admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:57.907795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1414/2797] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:57.911981 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737cff5-7260-4f5c-b1de-4d405ae5d3af admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:57.922412 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737cff5-7260-4f5c-b1de-4d405ae5d3af admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:57.926997 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf2df9-49a9-4959-8a77-c769e146076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:57.927651 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2df9-49a9-4959-8a77-c769e146076a admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:57.927936 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2df9-49a9-4959-8a77-c769e146076a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:57.928246 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2df9-49a9-4959-8a77-c769e146076a admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:57.928974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf2df9-49a9-4959-8a77-c769e146076a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:57.930596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf2df9-49a9-4959-8a77-c769e146076a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:57.941002 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1384/2798] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:57.944997 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42e9c1-57a9-47aa-9740-9d507b3b63da admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:57.955624 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42e9c1-57a9-47aa-9740-9d507b3b63da admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:57.960584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a42e0-c074-40f6-91f2-073222245b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:57.961474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a42e0-c074-40f6-91f2-073222245b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:57.961763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a42e0-c074-40f6-91f2-073222245b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:57.962091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a42e0-c074-40f6-91f2-073222245b0f admin admin] PATH_INFO: `/v3/projects/780b489dd6e0418c92fe2cecae0d40b8/users/518774d354754212ab9e3c54d809face/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:57.977190 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a42e0-c074-40f6-91f2-073222245b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=780b489dd6e0418c92fe2cecae0d40b8, user_id=518774d354754212ab9e3c54d809face, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:57.979862 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a42e0-c074-40f6-91f2-073222245b0f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:58.075687 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1415/2799] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:57 2022] PUT /identity/v3/projects/780b489dd6e0418c92fe2cecae0d40b8/users/518774d354754212ab9e3c54d809face/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:58:58.080896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aeda7-480c-43cc-aa5f-d2a19248d401 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:58.081196 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aeda7-480c-43cc-aa5f-d2a19248d401 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:58.083913 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aeda7-480c-43cc-aa5f-d2a19248d401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:58.099200 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-ab7aeda7-480c-43cc-aa5f-d2a19248d401 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:58.100391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ab7aeda7-480c-43cc-aa5f-d2a19248d401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:58.126266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:58.157995 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1385/2800] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:58.167832 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a42e0-c074-40f6-91f2-073222245b0f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:58.169518 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-fd0a42e0-c074-40f6-91f2-073222245b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:58.183440 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:58.226256 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a42e0-c074-40f6-91f2-073222245b0f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:58.230061 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb886f-6174-4ef2-b7f1-f4dabb8bbe05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:58.230717 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb886f-6174-4ef2-b7f1-f4dabb8bbe05 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:58.231007 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb886f-6174-4ef2-b7f1-f4dabb8bbe05 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:58.231286 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb886f-6174-4ef2-b7f1-f4dabb8bbe05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:58.240463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb886f-6174-4ef2-b7f1-f4dabb8bbe05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:58.241908 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb886f-6174-4ef2-b7f1-f4dabb8bbe05 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:58.251864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1416/2801] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:58:59.387851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6900604-3350-4611-bc68-90158c669fd8 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:59.388303 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6900604-3350-4611-bc68-90158c669fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:59.388418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6900604-3350-4611-bc68-90158c669fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:59.418247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-d6900604-3350-4611-bc68-90158c669fd8 None None] MFA Rules not processed for user `518774d354754212ab9e3c54d809face`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:59.419723 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-d6900604-3350-4611-bc68-90158c669fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:59.486409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1386/2802] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:58:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:59.490928 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb886f-6174-4ef2-b7f1-f4dabb8bbe05 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:59.500776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb886f-6174-4ef2-b7f1-f4dabb8bbe05 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:59.505379 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b23da0-9ebc-4638-a188-57cae3f0934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:59.506059 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23da0-9ebc-4638-a188-57cae3f0934e admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:59.506347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23da0-9ebc-4638-a188-57cae3f0934e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:59.506628 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23da0-9ebc-4638-a188-57cae3f0934e admin admin] PATH_INFO: `/v3/projects` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:59.507315 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b23da0-9ebc-4638-a188-57cae3f0934e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:59.509501 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b23da0-9ebc-4638-a188-57cae3f0934e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:59.590608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1417/2803] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:58:59 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:59.594868 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6900604-3350-4611-bc68-90158c669fd8 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:59.606091 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6900604-3350-4611-bc68-90158c669fd8 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:59.662591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409ba6f-341d-4018-874e-46a3a3957368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:59.663186 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409ba6f-341d-4018-874e-46a3a3957368 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:59.663474 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409ba6f-341d-4018-874e-46a3a3957368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:59.663767 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409ba6f-341d-4018-874e-46a3a3957368 admin admin] PATH_INFO: `/v3/users` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:59.664453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409ba6f-341d-4018-874e-46a3a3957368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:59.666422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409ba6f-341d-4018-874e-46a3a3957368 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:59.772530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1387/2804] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:58:59 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:58:59.776122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b23da0-9ebc-4638-a188-57cae3f0934e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:59.788842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b23da0-9ebc-4638-a188-57cae3f0934e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:59.794002 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3c008-c5be-459c-8ac0-c99b23b81d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:59.794680 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3c008-c5be-459c-8ac0-c99b23b81d5d admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:59.794985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3c008-c5be-459c-8ac0-c99b23b81d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:59.795255 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3c008-c5be-459c-8ac0-c99b23b81d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:59.796022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3c008-c5be-459c-8ac0-c99b23b81d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:59.797622 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3c008-c5be-459c-8ac0-c99b23b81d5d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:59.809759 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1418/2805] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:58:59.813975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409ba6f-341d-4018-874e-46a3a3957368 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:59.825882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409ba6f-341d-4018-874e-46a3a3957368 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:59.831150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a94a6-62a5-4a2d-9fae-34065f812d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:59.832038 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a94a6-62a5-4a2d-9fae-34065f812d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:59.832331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a94a6-62a5-4a2d-9fae-34065f812d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:59.832884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a94a6-62a5-4a2d-9fae-34065f812d64 admin admin] PATH_INFO: `/v3/projects/684e1f16924f49fb90690aa7d8c3da3c/users/ff80c54d73bf4566a1483a3f96ed8bb0/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:59.849682 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a94a6-62a5-4a2d-9fae-34065f812d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684e1f16924f49fb90690aa7d8c3da3c, user_id=ff80c54d73bf4566a1483a3f96ed8bb0, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:59.857464 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a94a6-62a5-4a2d-9fae-34065f812d64 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:00.046344 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1388/2806] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:58:59 2022] PUT /identity/v3/projects/684e1f16924f49fb90690aa7d8c3da3c/users/ff80c54d73bf4566a1483a3f96ed8bb0/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:00.050216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3c008-c5be-459c-8ac0-c99b23b81d5d admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:00.055211 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086c99-791c-41ed-8c73-11172b921b5a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:00.055539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086c99-791c-41ed-8c73-11172b921b5a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:00.055822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086c99-791c-41ed-8c73-11172b921b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:00.061003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3c008-c5be-459c-8ac0-c99b23b81d5d admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:00.074870 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-31086c99-791c-41ed-8c73-11172b921b5a None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:00.076056 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-31086c99-791c-41ed-8c73-11172b921b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:00.096993 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:00.123846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf8d82-68a7-4276-a8a4-5b1a7839a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:00.124556 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf8d82-68a7-4276-a8a4-5b1a7839a2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:00.124843 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf8d82-68a7-4276-a8a4-5b1a7839a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:00.125120 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf8d82-68a7-4276-a8a4-5b1a7839a2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:00.125850 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf8d82-68a7-4276-a8a4-5b1a7839a2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:00.128300 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf8d82-68a7-4276-a8a4-5b1a7839a2e2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:00.137675 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1389/2807] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:59:00.139522 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1419/2808] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:59:00.143573 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31086c99-791c-41ed-8c73-11172b921b5a None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:00.153427 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31086c99-791c-41ed-8c73-11172b921b5a None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:00.158047 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5e6e6-3911-4d8e-ac02-a04bc4d72b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:00.158917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e6e6-3911-4d8e-ac02-a04bc4d72b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:00.159205 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e6e6-3911-4d8e-ac02-a04bc4d72b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:00.159489 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e6e6-3911-4d8e-ac02-a04bc4d72b4a admin admin] PATH_INFO: `/v3/projects/684e1f16924f49fb90690aa7d8c3da3c/users/ff80c54d73bf4566a1483a3f96ed8bb0/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:00.161908 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5e6e6-3911-4d8e-ac02-a04bc4d72b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=684e1f16924f49fb90690aa7d8c3da3c, user_id=ff80c54d73bf4566a1483a3f96ed8bb0, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:00.163312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf8d82-68a7-4276-a8a4-5b1a7839a2e2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:00.164268 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5e6e6-3911-4d8e-ac02-a04bc4d72b4a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:00.164975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-55bf8d82-68a7-4276-a8a4-5b1a7839a2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:00.175687 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1390/2809] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:59:00 2022] PUT /identity/v3/projects/684e1f16924f49fb90690aa7d8c3da3c/users/ff80c54d73bf4566a1483a3f96ed8bb0/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:59:00.243372 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf8d82-68a7-4276-a8a4-5b1a7839a2e2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:00.255224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:00.308164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9f3e-3cb1-4445-8836-693a449b14c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:00.308820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9f3e-3cb1-4445-8836-693a449b14c4 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:00.309112 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9f3e-3cb1-4445-8836-693a449b14c4 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:00.309394 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9f3e-3cb1-4445-8836-693a449b14c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:00.375864 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9f3e-3cb1-4445-8836-693a449b14c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:00.377614 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9f3e-3cb1-4445-8836-693a449b14c4 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:00.387402 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1420/2810] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:59:01.395566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e09b7-3c93-4647-9054-63625ecefc3b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:01.396097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e09b7-3c93-4647-9054-63625ecefc3b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:01.396202 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e09b7-3c93-4647-9054-63625ecefc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:01.425845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4a3e09b7-3c93-4647-9054-63625ecefc3b None None] MFA Rules not processed for user `ff80c54d73bf4566a1483a3f96ed8bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:01.429566 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4a3e09b7-3c93-4647-9054-63625ecefc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:01.501020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1391/2811] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:01.563132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5c92a-db72-42c4-8449-63f0728ca6ec None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:01.563697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5c92a-db72-42c4-8449-63f0728ca6ec None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:01.563697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5c92a-db72-42c4-8449-63f0728ca6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:01.580633 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3ad5c92a-db72-42c4-8449-63f0728ca6ec None None] MFA Rules not processed for user `518774d354754212ab9e3c54d809face`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:01.581834 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3ad5c92a-db72-42c4-8449-63f0728ca6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:01.637430 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1421/2812] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:01.648281 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e09b7-3c93-4647-9054-63625ecefc3b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:01.649643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4a3e09b7-3c93-4647-9054-63625ecefc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:01.665902 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e09b7-3c93-4647-9054-63625ecefc3b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:01.672069 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bf117-4aea-4d4e-909e-3fdbc5cc63c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:01.672732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bf117-4aea-4d4e-909e-3fdbc5cc63c1 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:01.673016 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bf117-4aea-4d4e-909e-3fdbc5cc63c1 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:01.673294 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bf117-4aea-4d4e-909e-3fdbc5cc63c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:01.681108 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bf117-4aea-4d4e-909e-3fdbc5cc63c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:01.682736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bf117-4aea-4d4e-909e-3fdbc5cc63c1 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:01.691684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1392/2813] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:01.923141 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5c92a-db72-42c4-8449-63f0728ca6ec None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:01.975248 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5c92a-db72-42c4-8449-63f0728ca6ec None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:01.978821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7b93d-103a-48f3-915e-19c60f106832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:01.980014 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7b93d-103a-48f3-915e-19c60f106832 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:01.980295 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7b93d-103a-48f3-915e-19c60f106832 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:01.980568 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7b93d-103a-48f3-915e-19c60f106832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:01.982386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-dff7b93d-103a-48f3-915e-19c60f106832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:01.989508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=100 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:01.991757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7b93d-103a-48f3-915e-19c60f106832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:01.993184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7b93d-103a-48f3-915e-19c60f106832 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:02.001098 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1422/2814] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:11.677249 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bf117-4aea-4d4e-909e-3fdbc5cc63c1 service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:11.678699 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-361bf117-4aea-4d4e-909e-3fdbc5cc63c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:11.751376 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bf117-4aea-4d4e-909e-3fdbc5cc63c1 service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:11.756375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3238a52a3f6047e0acb0136ab39257e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:11.757060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:11.762382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:11.762382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:11.762382 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:11.771896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:11.773492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:11.783857 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1393/2815] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:59:12.103510 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:18.555847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24783-55d3-4036-a41b-12f92853cd48 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:18.556423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24783-55d3-4036-a41b-12f92853cd48 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:18.556423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24783-55d3-4036-a41b-12f92853cd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:18.574234 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-34a24783-55d3-4036-a41b-12f92853cd48 None None] MFA Rules not processed for user `8986355fdc9d45aab0dd19bc5aa5a0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:18.575423 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-34a24783-55d3-4036-a41b-12f92853cd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:18.629106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1423/2816] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:21.345812 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:21.347829 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:21.366966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:21.408928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2c7b-2ff6-4bb6-96e9-f08e35e8c592 service placement] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:21.412591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf240ad-1bf9-4c47-85a6-5b0ef214a725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:21.413266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf240ad-1bf9-4c47-85a6-5b0ef214a725 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:21.413554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf240ad-1bf9-4c47-85a6-5b0ef214a725 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:21.413999 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf240ad-1bf9-4c47-85a6-5b0ef214a725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:21.423946 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf240ad-1bf9-4c47-85a6-5b0ef214a725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:21.425405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf240ad-1bf9-4c47-85a6-5b0ef214a725 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:21.435300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1394/2817] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:28.622586 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=25 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:31.738124 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=19 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:36.570100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee47bc3-cb7a-4244-bacc-15c096864f1d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:36.570677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee47bc3-cb7a-4244-bacc-15c096864f1d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:36.570677 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee47bc3-cb7a-4244-bacc-15c096864f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:36.589384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-aee47bc3-cb7a-4244-bacc-15c096864f1d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:36.590673 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-aee47bc3-cb7a-4244-bacc-15c096864f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:36.600051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1424/2818] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:36.628966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf240ad-1bf9-4c47-85a6-5b0ef214a725 service cinder] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:36.642854 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf240ad-1bf9-4c47-85a6-5b0ef214a725 service cinder] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:36.648608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58e892-3baf-4672-9c80-68893d7facb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:36.649262 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58e892-3baf-4672-9c80-68893d7facb7 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:36.649551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58e892-3baf-4672-9c80-68893d7facb7 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:36.649833 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58e892-3baf-4672-9c80-68893d7facb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:36.659026 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58e892-3baf-4672-9c80-68893d7facb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:36.660600 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58e892-3baf-4672-9c80-68893d7facb7 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:36.670569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1395/2819] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:40.144723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75139a-e619-4ff5-a224-95b772fe76d9 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:40.145212 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75139a-e619-4ff5-a224-95b772fe76d9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:40.145418 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75139a-e619-4ff5-a224-95b772fe76d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:40.164078 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1d75139a-e619-4ff5-a224-95b772fe76d9 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:40.165292 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1d75139a-e619-4ff5-a224-95b772fe76d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:40.174004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1425/2820] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:40.201236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58e892-3baf-4672-9c80-68893d7facb7 service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:40.214171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58e892-3baf-4672-9c80-68893d7facb7 service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:40.221163 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39d526-9832-4396-81d6-da7093a7d21e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:40.222020 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39d526-9832-4396-81d6-da7093a7d21e service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:40.226012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39d526-9832-4396-81d6-da7093a7d21e service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:40.226012 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39d526-9832-4396-81d6-da7093a7d21e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:40.233271 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39d526-9832-4396-81d6-da7093a7d21e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:40.234975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39d526-9832-4396-81d6-da7093a7d21e service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:40.245150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1396/2821] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:43.008580 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9725f6-83fa-4334-85e3-dfd71441fe67 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:43.009049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9725f6-83fa-4334-85e3-dfd71441fe67 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:43.009169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9725f6-83fa-4334-85e3-dfd71441fe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:43.027388 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-3a9725f6-83fa-4334-85e3-dfd71441fe67 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:43.028569 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-3a9725f6-83fa-4334-85e3-dfd71441fe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:43.036191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1426/2822] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:43.059967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39d526-9832-4396-81d6-da7093a7d21e service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:43.071468 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39d526-9832-4396-81d6-da7093a7d21e service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:43.077666 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424cfe0-c1fe-4282-aab1-3db040740006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:43.078337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424cfe0-c1fe-4282-aab1-3db040740006 service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:43.078625 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424cfe0-c1fe-4282-aab1-3db040740006 service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:43.078905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424cfe0-c1fe-4282-aab1-3db040740006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:43.087113 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424cfe0-c1fe-4282-aab1-3db040740006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:43.088750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424cfe0-c1fe-4282-aab1-3db040740006 service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:43.098309 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1397/2823] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:45.864245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9725f6-83fa-4334-85e3-dfd71441fe67 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:45.874478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9725f6-83fa-4334-85e3-dfd71441fe67 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:45.879184 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:45.880052 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:45.880334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:45.880608 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] PATH_INFO: `/v3/users/518774d354754212ab9e3c54d809face` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:45.881796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=518774d354754212ab9e3c54d809face)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:45.883835 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:46.067403 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518774d354754212ab9e3c54d809face'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.130096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518774d354754212ab9e3c54d809face'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.142960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518774d354754212ab9e3c54d809face'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.143602 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518774d354754212ab9e3c54d809face'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.150411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518774d354754212ab9e3c54d809face'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.156920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1427/2824] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:59:45 2022] DELETE /identity/v3/users/518774d354754212ab9e3c54d809face => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:46.251702 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa5e8a-ce8d-477a-9650-5c6fb4928e71 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:46.252223 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa5e8a-ce8d-477a-9650-5c6fb4928e71 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:46.252325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa5e8a-ce8d-477a-9650-5c6fb4928e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:46.270862 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-67aa5e8a-ce8d-477a-9650-5c6fb4928e71 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:46.272101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-67aa5e8a-ce8d-477a-9650-5c6fb4928e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:46.337363 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1398/2825] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:59:46.379964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:46.381368 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:46.401958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa5e8a-ce8d-477a-9650-5c6fb4928e71 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:46.406125 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-67aa5e8a-ce8d-477a-9650-5c6fb4928e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:46.426781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa5e8a-ce8d-477a-9650-5c6fb4928e71 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:46.433388 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:46.434471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:46.434871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:46.435266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] PATH_INFO: `/v3/projects/780b489dd6e0418c92fe2cecae0d40b8` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:46.436535 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780b489dd6e0418c92fe2cecae0d40b8)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:46.438677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:46.464509 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cc6ea-203e-4ed5-9804-632d372ff7af admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:46.470796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df832d6-0be5-4ec0-8279-42ed35fdd320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:46.471475 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df832d6-0be5-4ec0-8279-42ed35fdd320 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:46.471765 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df832d6-0be5-4ec0-8279-42ed35fdd320 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:46.472049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df832d6-0be5-4ec0-8279-42ed35fdd320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:46.480416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df832d6-0be5-4ec0-8279-42ed35fdd320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:46.482057 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df832d6-0be5-4ec0-8279-42ed35fdd320 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:46.491465 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1428/2826] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:46.561845 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780b489dd6e0418c92fe2cecae0d40b8', 'request_id': 'req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.567972 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780b489dd6e0418c92fe2cecae0d40b8', 'request_id': 'req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.646406 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780b489dd6e0418c92fe2cecae0d40b8', 'request_id': 'req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.658609 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] The token cache is being invalidate because project 780b489dd6e0418c92fe2cecae0d40b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:59:46.658905 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.659577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.661210 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1399/2827] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:59:46 2022] DELETE /identity/v3/projects/780b489dd6e0418c92fe2cecae0d40b8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:46.665349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df832d6-0be5-4ec0-8279-42ed35fdd320 service nova] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:46.675051 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df832d6-0be5-4ec0-8279-42ed35fdd320 service nova] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:46.709787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:46.732215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:46.736069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:46.736069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:46.736069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] PATH_INFO: `/v3/users/ff80c54d73bf4566a1483a3f96ed8bb0` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:46.736069 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff80c54d73bf4566a1483a3f96ed8bb0)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:46.736818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:46.893876 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff80c54d73bf4566a1483a3f96ed8bb0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.943374 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff80c54d73bf4566a1483a3f96ed8bb0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.956526 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff80c54d73bf4566a1483a3f96ed8bb0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.957192 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff80c54d73bf4566a1483a3f96ed8bb0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.964204 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-bcb4f20b-c4e8-4637-b833-d31b8ce90102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff80c54d73bf4566a1483a3f96ed8bb0'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:46.970463 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1429/2828] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:59:46 2022] DELETE /identity/v3/users/ff80c54d73bf4566a1483a3f96ed8bb0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:47.212564 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:47.214118 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:47.229746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb10e1f-70e8-40d6-8bcf-06cd8147f2c1 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:47.273165 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:47.289018 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:47.289887 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:47.290217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:47.290501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] PATH_INFO: `/v3/projects/684e1f16924f49fb90690aa7d8c3da3c` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:47.291696 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684e1f16924f49fb90690aa7d8c3da3c)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:47.293637 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:47.392847 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684e1f16924f49fb90690aa7d8c3da3c', 'request_id': 'req-5a6b7919-6b92-494c-98fc-c652230bef38'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:47.398975 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684e1f16924f49fb90690aa7d8c3da3c', 'request_id': 'req-5a6b7919-6b92-494c-98fc-c652230bef38'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:47.484809 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684e1f16924f49fb90690aa7d8c3da3c', 'request_id': 'req-5a6b7919-6b92-494c-98fc-c652230bef38'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:47.495660 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] The token cache is being invalidate because project 684e1f16924f49fb90690aa7d8c3da3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:59:47.496159 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:47.497422 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-5a6b7919-6b92-494c-98fc-c652230bef38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:47.499492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1400/2829] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:59:47 2022] DELETE /identity/v3/projects/684e1f16924f49fb90690aa7d8c3da3c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:47.504327 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037d72-004f-420e-a82f-d3d1b29dff9f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:47.504714 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037d72-004f-420e-a82f-d3d1b29dff9f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:47.505004 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037d72-004f-420e-a82f-d3d1b29dff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:47.522609 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-f8037d72-004f-420e-a82f-d3d1b29dff9f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:47.523806 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-f8037d72-004f-420e-a82f-d3d1b29dff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:47.583217 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1430/2830] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:47.590779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09100a7-65da-4853-9612-a9baf9c64b7b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:47.591143 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09100a7-65da-4853-9612-a9baf9c64b7b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:47.591512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09100a7-65da-4853-9612-a9baf9c64b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:47.611572 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-e09100a7-65da-4853-9612-a9baf9c64b7b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:47.612834 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-e09100a7-65da-4853-9612-a9baf9c64b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:47.620574 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1401/2831] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:47.624828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8037d72-004f-420e-a82f-d3d1b29dff9f None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:47.634618 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8037d72-004f-420e-a82f-d3d1b29dff9f None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:47.640135 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2c69a-cf58-4555-88d0-da99fa3cfea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:47.640789 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2c69a-cf58-4555-88d0-da99fa3cfea9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:47.641079 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2c69a-cf58-4555-88d0-da99fa3cfea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:47.641361 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2c69a-cf58-4555-88d0-da99fa3cfea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:47.642119 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2c69a-cf58-4555-88d0-da99fa3cfea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:59:47.642436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2c69a-cf58-4555-88d0-da99fa3cfea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:47.644043 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2c69a-cf58-4555-88d0-da99fa3cfea9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:47.656437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1431/2832] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:59:47.660577 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09100a7-65da-4853-9612-a9baf9c64b7b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:47.669656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09100a7-65da-4853-9612-a9baf9c64b7b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:47.674316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4fd60-09c0-406b-b257-5e5905f10127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:47.674954 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4fd60-09c0-406b-b257-5e5905f10127 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:47.675237 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4fd60-09c0-406b-b257-5e5905f10127 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:47.675512 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4fd60-09c0-406b-b257-5e5905f10127 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:47.676206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4fd60-09c0-406b-b257-5e5905f10127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:47.678105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4fd60-09c0-406b-b257-5e5905f10127 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:47.767448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1402/2833] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:59:47 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:59:47.771435 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2c69a-cf58-4555-88d0-da99fa3cfea9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:47.781987 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2c69a-cf58-4555-88d0-da99fa3cfea9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:47.823283 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:47.838124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e28422-dc92-445c-bea9-ea33bc9731a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:47.838814 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e28422-dc92-445c-bea9-ea33bc9731a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:47.839122 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e28422-dc92-445c-bea9-ea33bc9731a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:47.839397 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e28422-dc92-445c-bea9-ea33bc9731a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:47.840074 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e28422-dc92-445c-bea9-ea33bc9731a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:47.842178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e28422-dc92-445c-bea9-ea33bc9731a5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:47.941607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1432/2834] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:59:47 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:59:47.945724 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4fd60-09c0-406b-b257-5e5905f10127 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:47.957445 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4fd60-09c0-406b-b257-5e5905f10127 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:47.962732 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710a03-d0cf-4b98-bb04-e1428d81e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:47.963400 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710a03-d0cf-4b98-bb04-e1428d81e94c admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:47.963766 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710a03-d0cf-4b98-bb04-e1428d81e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:47.964423 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710a03-d0cf-4b98-bb04-e1428d81e94c admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:47.964971 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc710a03-d0cf-4b98-bb04-e1428d81e94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:47.966705 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc710a03-d0cf-4b98-bb04-e1428d81e94c admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:47.979409 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1403/2835] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:59:47.982995 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e28422-dc92-445c-bea9-ea33bc9731a5 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:47.993088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e28422-dc92-445c-bea9-ea33bc9731a5 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:48.000873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56188221-fb84-48a7-927c-f65586bd76d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:48.000873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56188221-fb84-48a7-927c-f65586bd76d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:48.000873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56188221-fb84-48a7-927c-f65586bd76d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:48.000873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56188221-fb84-48a7-927c-f65586bd76d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:48.001281 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56188221-fb84-48a7-927c-f65586bd76d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:48.001691 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56188221-fb84-48a7-927c-f65586bd76d4 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:48.011852 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1433/2836] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:59:48.016362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710a03-d0cf-4b98-bb04-e1428d81e94c admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:48.027000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710a03-d0cf-4b98-bb04-e1428d81e94c admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:48.031797 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff4a6d-8026-4693-bbde-1e7c905710fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:48.032679 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff4a6d-8026-4693-bbde-1e7c905710fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:48.032966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff4a6d-8026-4693-bbde-1e7c905710fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:48.033315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff4a6d-8026-4693-bbde-1e7c905710fe admin admin] PATH_INFO: `/v3/projects/8f73680f978e402285283a6b48af15c0/users/d5c39dc4c9424d72b58e4f2c7cd50d10/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:48.047886 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff4a6d-8026-4693-bbde-1e7c905710fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f73680f978e402285283a6b48af15c0, user_id=d5c39dc4c9424d72b58e4f2c7cd50d10, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:48.050755 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff4a6d-8026-4693-bbde-1e7c905710fe admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:48.132105 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1404/2837] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:59:48 2022] PUT /identity/v3/projects/8f73680f978e402285283a6b48af15c0/users/d5c39dc4c9424d72b58e4f2c7cd50d10/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:48.143446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c00e-ba20-4392-a9d4-e02403e77b8a None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:48.143748 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c00e-ba20-4392-a9d4-e02403e77b8a None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:48.144036 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c00e-ba20-4392-a9d4-e02403e77b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:48.170540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-0b77c00e-ba20-4392-a9d4-e02403e77b8a None None] MFA Rules not processed for user `d5c39dc4c9424d72b58e4f2c7cd50d10`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:48.171858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0b77c00e-ba20-4392-a9d4-e02403e77b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:48.236438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1434/2838] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:48.247343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff4a6d-8026-4693-bbde-1e7c905710fe admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:48.249581 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4bff4a6d-8026-4693-bbde-1e7c905710fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:48.310368 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff4a6d-8026-4693-bbde-1e7c905710fe admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:48.314023 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf196f-1ab3-409b-aac0-b47fcceb1381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:48.314670 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf196f-1ab3-409b-aac0-b47fcceb1381 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:48.314953 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf196f-1ab3-409b-aac0-b47fcceb1381 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:48.315232 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf196f-1ab3-409b-aac0-b47fcceb1381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:48.323475 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf196f-1ab3-409b-aac0-b47fcceb1381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:48.324896 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf196f-1ab3-409b-aac0-b47fcceb1381 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:48.333736 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1405/2839] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:48.353191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c00e-ba20-4392-a9d4-e02403e77b8a None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:48.415992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c00e-ba20-4392-a9d4-e02403e77b8a None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:48.420497 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:48.421360 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:48.421641 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:48.421917 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] PATH_INFO: `/v3/users/d5c39dc4c9424d72b58e4f2c7cd50d10` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:48.423149 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c39dc4c9424d72b58e4f2c7cd50d10)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:48.425106 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:48.586081 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c39dc4c9424d72b58e4f2c7cd50d10'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:48.644084 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c39dc4c9424d72b58e4f2c7cd50d10'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:48.645450 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:48.657873 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c39dc4c9424d72b58e4f2c7cd50d10'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:48.658730 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c39dc4c9424d72b58e4f2c7cd50d10'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:48.665894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c39dc4c9424d72b58e4f2c7cd50d10'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:48.671944 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1435/2840] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:59:48 2022] DELETE /identity/v3/users/d5c39dc4c9424d72b58e4f2c7cd50d10 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:48.676731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553662f-c75f-4c9c-91b7-933e4a013f7b None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:48.677026 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553662f-c75f-4c9c-91b7-933e4a013f7b None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:48.677310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553662f-c75f-4c9c-91b7-933e4a013f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:48.694799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-6553662f-c75f-4c9c-91b7-933e4a013f7b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:48.696057 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6553662f-c75f-4c9c-91b7-933e4a013f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:48.704856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:48.756706 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1406/2841] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:48.766924 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:48.768351 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:48.825178 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51582a32-c292-427a-a926-301b24db4cdf admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:48.829663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd8a97-56ef-462d-8cf1-a979e3f164c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:48.830337 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd8a97-56ef-462d-8cf1-a979e3f164c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:48.830694 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd8a97-56ef-462d-8cf1-a979e3f164c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:48.831087 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd8a97-56ef-462d-8cf1-a979e3f164c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:48.842215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd8a97-56ef-462d-8cf1-a979e3f164c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:48.842215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd8a97-56ef-462d-8cf1-a979e3f164c8 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:48.851828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1436/2842] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:49.268320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553662f-c75f-4c9c-91b7-933e4a013f7b None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:49.269741 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-6553662f-c75f-4c9c-91b7-933e4a013f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:49.282198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553662f-c75f-4c9c-91b7-933e4a013f7b None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:49.286804 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:49.287677 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:49.287966 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:49.288248 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] PATH_INFO: `/v3/projects/8f73680f978e402285283a6b48af15c0` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:49.289569 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f73680f978e402285283a6b48af15c0)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:49.291554 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:49.412730 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f73680f978e402285283a6b48af15c0', 'request_id': 'req-d3708b14-0279-49c9-bca5-8262fae7be8f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:49.418872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f73680f978e402285283a6b48af15c0', 'request_id': 'req-d3708b14-0279-49c9-bca5-8262fae7be8f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:49.480751 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f73680f978e402285283a6b48af15c0', 'request_id': 'req-d3708b14-0279-49c9-bca5-8262fae7be8f'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:49.492393 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] The token cache is being invalidate because project 8f73680f978e402285283a6b48af15c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:59:49.492708 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:49.493331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-d3708b14-0279-49c9-bca5-8262fae7be8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:49.494956 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1407/2843] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:59:49 2022] DELETE /identity/v3/projects/8f73680f978e402285283a6b48af15c0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:49.499838 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91117239-36f4-4f9c-a831-27a7f814ac1d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:49.500314 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91117239-36f4-4f9c-a831-27a7f814ac1d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:49.500413 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91117239-36f4-4f9c-a831-27a7f814ac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:49.509842 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc9d2-42a3-49cd-ae2a-f6c13a25eeb4 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:49.510166 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc9d2-42a3-49cd-ae2a-f6c13a25eeb4 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:49.510450 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc9d2-42a3-49cd-ae2a-f6c13a25eeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:49.519161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-91117239-36f4-4f9c-a831-27a7f814ac1d None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:49.520414 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-91117239-36f4-4f9c-a831-27a7f814ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:49.528863 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-60dcc9d2-42a3-49cd-ae2a-f6c13a25eeb4 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:49.530643 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-60dcc9d2-42a3-49cd-ae2a-f6c13a25eeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:49.581189 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1437/2844] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:59:49.588872 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4764f-af1a-42d1-bcdc-bbc25e65bb2b None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:49.589310 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4764f-af1a-42d1-bcdc-bbc25e65bb2b None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:49.589590 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4764f-af1a-42d1-bcdc-bbc25e65bb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:49.590416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1408/2845] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jun 30 10:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:59:49.607447 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-a8c4764f-af1a-42d1-bcdc-bbc25e65bb2b None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:49.608690 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a8c4764f-af1a-42d1-bcdc-bbc25e65bb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:49.616372 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1438/2846] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:49.620713 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcc9d2-42a3-49cd-ae2a-f6c13a25eeb4 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:49.629132 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4764f-af1a-42d1-bcdc-bbc25e65bb2b None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:49.630532 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a8c4764f-af1a-42d1-bcdc-bbc25e65bb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:49.631846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcc9d2-42a3-49cd-ae2a-f6c13a25eeb4 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:49.636592 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92e142-7a24-4692-8154-6b7edc0d18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:49.637253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92e142-7a24-4692-8154-6b7edc0d18bc admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:49.637542 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92e142-7a24-4692-8154-6b7edc0d18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:49.637822 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92e142-7a24-4692-8154-6b7edc0d18bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:49.638659 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92e142-7a24-4692-8154-6b7edc0d18bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:59:49.638974 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92e142-7a24-4692-8154-6b7edc0d18bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:49.641216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92e142-7a24-4692-8154-6b7edc0d18bc admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:49.653360 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1409/2847] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:59:49.662476 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92e142-7a24-4692-8154-6b7edc0d18bc admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:49.672405 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92e142-7a24-4692-8154-6b7edc0d18bc admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:49.676865 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0023a4e-c69d-4115-b634-075931281bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:49.677501 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0023a4e-c69d-4115-b634-075931281bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:49.677787 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0023a4e-c69d-4115-b634-075931281bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:49.678100 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0023a4e-c69d-4115-b634-075931281bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:49.678772 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0023a4e-c69d-4115-b634-075931281bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:49.680747 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0023a4e-c69d-4115-b634-075931281bb8 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:49.704302 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4764f-af1a-42d1-bcdc-bbc25e65bb2b None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:49.709858 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d865-5993-40b6-86ff-b775d52829ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:49.710529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d865-5993-40b6-86ff-b775d52829ba service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:49.710813 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d865-5993-40b6-86ff-b775d52829ba service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:49.711091 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d865-5993-40b6-86ff-b775d52829ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:49.716218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:49.720159 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286d865-5993-40b6-86ff-b775d52829ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:49.721732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286d865-5993-40b6-86ff-b775d52829ba service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:49.731233 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1439/2848] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:59:49.779253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1410/2849] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:59:49 2022] POST /identity/v3/projects => generated 359 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:59:49.783167 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d865-5993-40b6-86ff-b775d52829ba service nova] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:49.792910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d865-5993-40b6-86ff-b775d52829ba service nova] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:49.848916 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f437b29-4d5a-4092-9227-9215b0aa0af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:49.849585 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f437b29-4d5a-4092-9227-9215b0aa0af0 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:49.849875 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f437b29-4d5a-4092-9227-9215b0aa0af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:49.850200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f437b29-4d5a-4092-9227-9215b0aa0af0 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:49.850880 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f437b29-4d5a-4092-9227-9215b0aa0af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:49.852796 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f437b29-4d5a-4092-9227-9215b0aa0af0 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:49.949143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1440/2850] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:59:49 2022] POST /identity/v3/users => generated 280 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:59:49.953168 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0023a4e-c69d-4115-b634-075931281bb8 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:49.958850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:49.964320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0023a4e-c69d-4115-b634-075931281bb8 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:49.969242 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921b869-e8c4-4c2a-97e9-845a650b490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:49.969898 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921b869-e8c4-4c2a-97e9-845a650b490d admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:49.970225 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921b869-e8c4-4c2a-97e9-845a650b490d admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:49.970591 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921b869-e8c4-4c2a-97e9-845a650b490d admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:49.971318 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921b869-e8c4-4c2a-97e9-845a650b490d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:49.972912 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921b869-e8c4-4c2a-97e9-845a650b490d admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:49.983557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1411/2851] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:59:49.987393 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f437b29-4d5a-4092-9227-9215b0aa0af0 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:49.997382 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f437b29-4d5a-4092-9227-9215b0aa0af0 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:50.002665 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6239f1d-d767-48fd-84b3-1b2e33018f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:50.003319 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6239f1d-d767-48fd-84b3-1b2e33018f4e admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:50.003607 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6239f1d-d767-48fd-84b3-1b2e33018f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:50.003889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6239f1d-d767-48fd-84b3-1b2e33018f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:50.004619 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6239f1d-d767-48fd-84b3-1b2e33018f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:50.006262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6239f1d-d767-48fd-84b3-1b2e33018f4e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:50.016262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1441/2852] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:59:50.020641 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921b869-e8c4-4c2a-97e9-845a650b490d admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:50.031185 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921b869-e8c4-4c2a-97e9-845a650b490d admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:50.035840 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68080e-9f17-44f9-9c29-afe1066130f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:50.036750 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68080e-9f17-44f9-9c29-afe1066130f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:50.037053 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68080e-9f17-44f9-9c29-afe1066130f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:50.037539 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68080e-9f17-44f9-9c29-afe1066130f2 admin admin] PATH_INFO: `/v3/projects/7058788c4635496eb35f2bb122bd887e/users/057393e2dc334dcfa67b62c4fb80e9d1/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:50.053142 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68080e-9f17-44f9-9c29-afe1066130f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7058788c4635496eb35f2bb122bd887e, user_id=057393e2dc334dcfa67b62c4fb80e9d1, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:50.055934 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68080e-9f17-44f9-9c29-afe1066130f2 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:50.124597 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1412/2853] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:59:50 2022] PUT /identity/v3/projects/7058788c4635496eb35f2bb122bd887e/users/057393e2dc334dcfa67b62c4fb80e9d1/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:59:50.134663 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5dce-3018-44f2-a343-1a97a18a94ac None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:50.134960 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5dce-3018-44f2-a343-1a97a18a94ac None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:50.135245 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5dce-3018-44f2-a343-1a97a18a94ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:50.160992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-0b6e5dce-3018-44f2-a343-1a97a18a94ac None None] MFA Rules not processed for user `057393e2dc334dcfa67b62c4fb80e9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:50.162226 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0b6e5dce-3018-44f2-a343-1a97a18a94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:50.224348 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1442/2854] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:50 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:50.255217 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68080e-9f17-44f9-9c29-afe1066130f2 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:50.257006 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-9b68080e-9f17-44f9-9c29-afe1066130f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:50.317129 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68080e-9f17-44f9-9c29-afe1066130f2 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:50.320894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a0025-9ea8-4759-b0fe-28fa771ddaec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:50.321544 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a0025-9ea8-4759-b0fe-28fa771ddaec service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:50.321835 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a0025-9ea8-4759-b0fe-28fa771ddaec service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:50.322153 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a0025-9ea8-4759-b0fe-28fa771ddaec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:50.330589 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a0025-9ea8-4759-b0fe-28fa771ddaec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:50.332014 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a0025-9ea8-4759-b0fe-28fa771ddaec service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:50.340771 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1413/2855] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:50 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:50.356436 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e5dce-3018-44f2-a343-1a97a18a94ac None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:50.421214 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e5dce-3018-44f2-a343-1a97a18a94ac None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:50.426473 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:50.427347 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:50.427746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:50.428034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] PATH_INFO: `/v3/users/057393e2dc334dcfa67b62c4fb80e9d1` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:50.429241 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=057393e2dc334dcfa67b62c4fb80e9d1)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:50.431230 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:50.434161 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:50.670272 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '057393e2dc334dcfa67b62c4fb80e9d1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:50.752964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '057393e2dc334dcfa67b62c4fb80e9d1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:50.765713 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '057393e2dc334dcfa67b62c4fb80e9d1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:50.766366 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '057393e2dc334dcfa67b62c4fb80e9d1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:50.773546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '057393e2dc334dcfa67b62c4fb80e9d1'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:50.779554 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1443/2856] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 10:59:50 2022] DELETE /identity/v3/users/057393e2dc334dcfa67b62c4fb80e9d1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:50.784815 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09b7f-3363-448a-9f2d-991eec52c8e9 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:50.785308 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09b7f-3363-448a-9f2d-991eec52c8e9 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:50.785407 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09b7f-3363-448a-9f2d-991eec52c8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:50.802364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4cb09b7f-3363-448a-9f2d-991eec52c8e9 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:50.803559 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4cb09b7f-3363-448a-9f2d-991eec52c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:50.861046 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1414/2857] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:50.870637 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:50.872013 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:50.929587 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3c1a-4e6f-49aa-95cb-eafafde84cea admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:50.933262 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79dbb0-4a57-4e15-8070-ab5b1d819550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:50.933967 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79dbb0-4a57-4e15-8070-ab5b1d819550 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:50.934259 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79dbb0-4a57-4e15-8070-ab5b1d819550 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:50.934542 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79dbb0-4a57-4e15-8070-ab5b1d819550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:50.943651 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79dbb0-4a57-4e15-8070-ab5b1d819550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:50.945080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79dbb0-4a57-4e15-8070-ab5b1d819550 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:50.955058 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1444/2858] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:51.354778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb09b7f-3363-448a-9f2d-991eec52c8e9 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:51.356269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4cb09b7f-3363-448a-9f2d-991eec52c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:51.368764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb09b7f-3363-448a-9f2d-991eec52c8e9 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:51.376008 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:51.377870 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:51.378195 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:51.378743 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] PATH_INFO: `/v3/projects/7058788c4635496eb35f2bb122bd887e` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:51.380044 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7058788c4635496eb35f2bb122bd887e)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:51.382781 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:51.485127 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7058788c4635496eb35f2bb122bd887e', 'request_id': 'req-98e6de38-2766-4091-9f7d-3adc9c28b59e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:51.491354 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7058788c4635496eb35f2bb122bd887e', 'request_id': 'req-98e6de38-2766-4091-9f7d-3adc9c28b59e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:51.560116 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7058788c4635496eb35f2bb122bd887e', 'request_id': 'req-98e6de38-2766-4091-9f7d-3adc9c28b59e'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:51.565129 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:51.572050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] The token cache is being invalidate because project 7058788c4635496eb35f2bb122bd887e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:59:51.572334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:51.572943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-98e6de38-2766-4091-9f7d-3adc9c28b59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:59:51.574531 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1415/2859] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 10:59:51 2022] DELETE /identity/v3/projects/7058788c4635496eb35f2bb122bd887e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:51.579410 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da55d05-c6fc-4307-8bcf-b103d853f5f9 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:51.579709 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da55d05-c6fc-4307-8bcf-b103d853f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:51.579991 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da55d05-c6fc-4307-8bcf-b103d853f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:51.597507 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-1da55d05-c6fc-4307-8bcf-b103d853f5f9 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:51.598749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-1da55d05-c6fc-4307-8bcf-b103d853f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:51.662746 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1445/2860] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:51.672434 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb7fc-797b-430e-9151-cfe057420bdc None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:51.672728 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb7fc-797b-430e-9151-cfe057420bdc None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:51.673010 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb7fc-797b-430e-9151-cfe057420bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:51.692920 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-54fdb7fc-797b-430e-9151-cfe057420bdc None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:51.694169 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-54fdb7fc-797b-430e-9151-cfe057420bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:51.702215 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1416/2861] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:51.706703 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da55d05-c6fc-4307-8bcf-b103d853f5f9 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:51.719657 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da55d05-c6fc-4307-8bcf-b103d853f5f9 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:51.725088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1f79d-1265-43c7-ae6b-2e64295c0021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:51.725745 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f79d-1265-43c7-ae6b-2e64295c0021 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:51.726077 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f79d-1265-43c7-ae6b-2e64295c0021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:51.726364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f79d-1265-43c7-ae6b-2e64295c0021 admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:51.727100 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1f79d-1265-43c7-ae6b-2e64295c0021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:59:51.727416 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1f79d-1265-43c7-ae6b-2e64295c0021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:51.729065 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1f79d-1265-43c7-ae6b-2e64295c0021 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:51.741138 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1446/2862] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 10:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:59:51.745315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb7fc-797b-430e-9151-cfe057420bdc None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:51.755218 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb7fc-797b-430e-9151-cfe057420bdc None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:51.759878 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d48dca-00ca-4443-8385-eab860bf7302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:51.760525 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48dca-00ca-4443-8385-eab860bf7302 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:51.760815 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48dca-00ca-4443-8385-eab860bf7302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:51.761097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48dca-00ca-4443-8385-eab860bf7302 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:51.761824 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d48dca-00ca-4443-8385-eab860bf7302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:51.763768 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d48dca-00ca-4443-8385-eab860bf7302 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:51.851622 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1417/2863] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:59:51 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:59:51.855763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1f79d-1265-43c7-ae6b-2e64295c0021 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:51.866474 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1f79d-1265-43c7-ae6b-2e64295c0021 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:51.874530 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:51.923547 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4773dd5-ec63-4266-9c6d-7cd63b344df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:51.924215 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773dd5-ec63-4266-9c6d-7cd63b344df2 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:51.924502 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773dd5-ec63-4266-9c6d-7cd63b344df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:51.924781 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773dd5-ec63-4266-9c6d-7cd63b344df2 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:51.925484 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4773dd5-ec63-4266-9c6d-7cd63b344df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:51.927441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4773dd5-ec63-4266-9c6d-7cd63b344df2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:52.045830 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1447/2864] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:59:51 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:59:52.049849 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d48dca-00ca-4443-8385-eab860bf7302 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:52.060173 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d48dca-00ca-4443-8385-eab860bf7302 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:52.064871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2dde9-68fc-4a95-b615-685e3483b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:52.065514 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2dde9-68fc-4a95-b615-685e3483b3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:52.065983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2dde9-68fc-4a95-b615-685e3483b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:52.066101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2dde9-68fc-4a95-b615-685e3483b3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:52.066850 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2dde9-68fc-4a95-b615-685e3483b3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:52.068509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2dde9-68fc-4a95-b615-685e3483b3d3 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:52.079893 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1418/2865] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:59:52.083988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4773dd5-ec63-4266-9c6d-7cd63b344df2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:52.095555 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4773dd5-ec63-4266-9c6d-7cd63b344df2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:52.100438 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85fab-1985-44b7-a6f0-211863029cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:52.101143 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85fab-1985-44b7-a6f0-211863029cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:52.103358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85fab-1985-44b7-a6f0-211863029cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:52.103358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85fab-1985-44b7-a6f0-211863029cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:52.103358 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e85fab-1985-44b7-a6f0-211863029cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:52.104260 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e85fab-1985-44b7-a6f0-211863029cf5 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:52.115795 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1448/2866] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:59:52.123383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2dde9-68fc-4a95-b615-685e3483b3d3 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:52.133446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2dde9-68fc-4a95-b615-685e3483b3d3 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:52.138119 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18af5b6-d97d-4ced-b861-5720b8918820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:52.138983 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18af5b6-d97d-4ced-b861-5720b8918820 admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:52.139799 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18af5b6-d97d-4ced-b861-5720b8918820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:52.140083 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18af5b6-d97d-4ced-b861-5720b8918820 admin admin] PATH_INFO: `/v3/projects/a8fa709f09cf47e68b16ddc2896a6b1f/users/448bf0ab9e98421588f376fcf371fdf6/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:52.154532 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18af5b6-d97d-4ced-b861-5720b8918820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8fa709f09cf47e68b16ddc2896a6b1f, user_id=448bf0ab9e98421588f376fcf371fdf6, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:52.157776 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18af5b6-d97d-4ced-b861-5720b8918820 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:52.227216 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1419/2867] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:59:52 2022] PUT /identity/v3/projects/a8fa709f09cf47e68b16ddc2896a6b1f/users/448bf0ab9e98421588f376fcf371fdf6/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:52.232508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993cbb8-4895-4006-81a8-b482028d909f None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:52.232822 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993cbb8-4895-4006-81a8-b482028d909f None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:52.233650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993cbb8-4895-4006-81a8-b482028d909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:52.251974 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-b993cbb8-4895-4006-81a8-b482028d909f None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:52.253221 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-b993cbb8-4895-4006-81a8-b482028d909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:52.310648 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1449/2868] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:52.320879 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18af5b6-d97d-4ced-b861-5720b8918820 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:52.322640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f18af5b6-d97d-4ced-b861-5720b8918820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:52.379731 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18af5b6-d97d-4ced-b861-5720b8918820 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:52.383337 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11367fc-03ea-477e-ab1f-b327f7221603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:52.383985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11367fc-03ea-477e-ab1f-b327f7221603 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:52.384276 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11367fc-03ea-477e-ab1f-b327f7221603 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:52.384557 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11367fc-03ea-477e-ab1f-b327f7221603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:52.394074 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11367fc-03ea-477e-ab1f-b327f7221603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:52.395500 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11367fc-03ea-477e-ab1f-b327f7221603 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:52.404872 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1420/2869] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:57.677844 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9467af-26a5-4126-9026-b7c4ec2bcb93 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:57.678317 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9467af-26a5-4126-9026-b7c4ec2bcb93 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:57.678441 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9467af-26a5-4126-9026-b7c4ec2bcb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:57.706613 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-be9467af-26a5-4126-9026-b7c4ec2bcb93 None None] MFA Rules not processed for user `448bf0ab9e98421588f376fcf371fdf6`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:59:57.707820 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-be9467af-26a5-4126-9026-b7c4ec2bcb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:57.776307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1450/2870] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 10:59:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:59:57.780967 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11367fc-03ea-477e-ab1f-b327f7221603 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:57.791841 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11367fc-03ea-477e-ab1f-b327f7221603 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:57.796611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8087324-7972-4495-b3ec-a510600707b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:57.797851 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8087324-7972-4495-b3ec-a510600707b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:57.798174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8087324-7972-4495-b3ec-a510600707b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:57.798465 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8087324-7972-4495-b3ec-a510600707b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:57.799157 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8087324-7972-4495-b3ec-a510600707b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:57.801081 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8087324-7972-4495-b3ec-a510600707b0 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:57.905260 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1421/2871] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 10:59:57 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:59:57.909271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9467af-26a5-4126-9026-b7c4ec2bcb93 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:57.919910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9467af-26a5-4126-9026-b7c4ec2bcb93 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:57.936053 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:57.976791 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69843b-1b58-49f7-8f38-b4c93cd8d6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:57.977459 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69843b-1b58-49f7-8f38-b4c93cd8d6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:57.977818 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69843b-1b58-49f7-8f38-b4c93cd8d6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:57.978092 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69843b-1b58-49f7-8f38-b4c93cd8d6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:57.978784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69843b-1b58-49f7-8f38-b4c93cd8d6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:57.980706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69843b-1b58-49f7-8f38-b4c93cd8d6a7 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:58.055767 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1451/2872] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 10:59:57 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:59:58.059665 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8087324-7972-4495-b3ec-a510600707b0 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:58.086180 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8087324-7972-4495-b3ec-a510600707b0 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:58.090555 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3111bf-7dc0-441c-8122-41e493beacba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:58.091174 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3111bf-7dc0-441c-8122-41e493beacba admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:58.091915 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3111bf-7dc0-441c-8122-41e493beacba admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:58.092206 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3111bf-7dc0-441c-8122-41e493beacba admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:58.093235 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3111bf-7dc0-441c-8122-41e493beacba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:58.095019 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3111bf-7dc0-441c-8122-41e493beacba admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:58.110998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1422/2873] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:59:58.112349 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69843b-1b58-49f7-8f38-b4c93cd8d6a7 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:58.123964 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69843b-1b58-49f7-8f38-b4c93cd8d6a7 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:58.129644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288cb78-78b4-40d1-a330-41e0191c02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:58.130635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cb78-78b4-40d1-a330-41e0191c02bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:58.130992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cb78-78b4-40d1-a330-41e0191c02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:58.131341 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cb78-78b4-40d1-a330-41e0191c02bb admin admin] PATH_INFO: `/v3/projects/3c33d632ae7b4bbcbea42a72686cb8be/users/a1599cc669e841afa147c0e2aee17c91/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:58.147723 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288cb78-78b4-40d1-a330-41e0191c02bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c33d632ae7b4bbcbea42a72686cb8be, user_id=a1599cc669e841afa147c0e2aee17c91, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:58.150483 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288cb78-78b4-40d1-a330-41e0191c02bb admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:58.226661 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1452/2874] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:59:58 2022] PUT /identity/v3/projects/3c33d632ae7b4bbcbea42a72686cb8be/users/a1599cc669e841afa147c0e2aee17c91/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:59:58.232836 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3111bf-7dc0-441c-8122-41e493beacba admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:58.243408 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3111bf-7dc0-441c-8122-41e493beacba admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:58.308697 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89235-41f2-49be-addc-b90feb623b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:58.309541 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89235-41f2-49be-addc-b90feb623b71 admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:58.309925 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89235-41f2-49be-addc-b90feb623b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:58.310345 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89235-41f2-49be-addc-b90feb623b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:58.311198 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a89235-41f2-49be-addc-b90feb623b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:58.313744 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a89235-41f2-49be-addc-b90feb623b71 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:58.315383 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:58.325518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1423/2875] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 10:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:59:58.330165 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288cb78-78b4-40d1-a330-41e0191c02bb admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:58.341172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288cb78-78b4-40d1-a330-41e0191c02bb admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:58.346812 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571480-18aa-4c1e-b43a-9ad82953acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:58.348075 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571480-18aa-4c1e-b43a-9ad82953acc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:58.348364 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571480-18aa-4c1e-b43a-9ad82953acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:58.348640 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571480-18aa-4c1e-b43a-9ad82953acc2 admin admin] PATH_INFO: `/v3/projects/3c33d632ae7b4bbcbea42a72686cb8be/users/a1599cc669e841afa147c0e2aee17c91/roles/d1911a6ba3474c3698626857c3bbb1f7` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:58.350621 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed571480-18aa-4c1e-b43a-9ad82953acc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c33d632ae7b4bbcbea42a72686cb8be, user_id=a1599cc669e841afa147c0e2aee17c91, role_id=d1911a6ba3474c3698626857c3bbb1f7)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:58.353411 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed571480-18aa-4c1e-b43a-9ad82953acc2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:58.364283 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1453/2876] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 10:59:58 2022] PUT /identity/v3/projects/3c33d632ae7b4bbcbea42a72686cb8be/users/a1599cc669e841afa147c0e2aee17c91/roles/d1911a6ba3474c3698626857c3bbb1f7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:00:04.311764 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651d145-4957-4114-970b-66519bb11c5a None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:04.312715 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651d145-4957-4114-970b-66519bb11c5a None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:04.313171 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651d145-4957-4114-970b-66519bb11c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:04.352097 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-4651d145-4957-4114-970b-66519bb11c5a None None] MFA Rules not processed for user `a1599cc669e841afa147c0e2aee17c91`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:00:04.353998 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4651d145-4957-4114-970b-66519bb11c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:04.453391 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1424/2877] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 11:00:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 11:00:04.465770 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571480-18aa-4c1e-b43a-9ad82953acc2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:04.468088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-ed571480-18aa-4c1e-b43a-9ad82953acc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:04.537498 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571480-18aa-4c1e-b43a-9ad82953acc2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:04.542279 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75160989-f722-4c07-8b06-d3723e52a610 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e839d1074f24a5ba7a552472e167067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:04.543191 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75160989-f722-4c07-8b06-d3723e52a610 service glance] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:04.543481 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75160989-f722-4c07-8b06-d3723e52a610 service glance] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:04.543773 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75160989-f722-4c07-8b06-d3723e52a610 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:04.614109 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75160989-f722-4c07-8b06-d3723e52a610 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:04.615888 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75160989-f722-4c07-8b06-d3723e52a610 service glance] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:04.626088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1454/2878] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:00:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 11:00:04.829853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3db6-f024-419a-895d-fedf4c8b9260 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:04.830177 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3db6-f024-419a-895d-fedf4c8b9260 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:04.830454 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3db6-f024-419a-895d-fedf4c8b9260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:04.848366 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-890f3db6-f024-419a-895d-fedf4c8b9260 None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:00:04.849748 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-890f3db6-f024-419a-895d-fedf4c8b9260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:04.912504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1425/2879] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 11:00:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 11:00:05.048478 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75160989-f722-4c07-8b06-d3723e52a610 service glance] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:05.050022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-75160989-f722-4c07-8b06-d3723e52a610 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:05.087793 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:05.128200 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75160989-f722-4c07-8b06-d3723e52a610 service glance] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:05.133352 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c48f10-83a9-4803-b61a-8bc5e9e698ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:05.134043 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48f10-83a9-4803-b61a-8bc5e9e698ee service swift] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:05.134334 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48f10-83a9-4803-b61a-8bc5e9e698ee service swift] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:05.134615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48f10-83a9-4803-b61a-8bc5e9e698ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:05.143156 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c48f10-83a9-4803-b61a-8bc5e9e698ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:05.144768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c48f10-83a9-4803-b61a-8bc5e9e698ee service swift] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:05.153576 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1455/2880] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 11:00:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 11:00:14.905517 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=61 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:15.210339 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=20 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:15.578374 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e90062-fd41-43b5-b1a2-9c059c393f21 None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:15.578672 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e90062-fd41-43b5-b1a2-9c059c393f21 None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:15.578958 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e90062-fd41-43b5-b1a2-9c059c393f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:15.596987 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-f4e90062-fd41-43b5-b1a2-9c059c393f21 None None] MFA Rules not processed for user `448bf0ab9e98421588f376fcf371fdf6`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:00:15.598234 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-f4e90062-fd41-43b5-b1a2-9c059c393f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:15.605095 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1426/2881] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 11:00:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 11:00:19.143164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ec6f7-2b2e-4590-ac3e-4dcd452d8428 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:19.143675 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ec6f7-2b2e-4590-ac3e-4dcd452d8428 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:19.143776 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ec6f7-2b2e-4590-ac3e-4dcd452d8428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:19.161644 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-596ec6f7-2b2e-4590-ac3e-4dcd452d8428 None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:00:19.162889 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-596ec6f7-2b2e-4590-ac3e-4dcd452d8428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:19.170529 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1456/2882] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jun 30 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 11:00:19.182921 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e90062-fd41-43b5-b1a2-9c059c393f21 None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:19.195103 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e90062-fd41-43b5-b1a2-9c059c393f21 None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:19.200121 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9597f-b92f-409d-8eaa-2c18b3ae22a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:19.200770 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9597f-b92f-409d-8eaa-2c18b3ae22a8 service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:19.201060 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9597f-b92f-409d-8eaa-2c18b3ae22a8 service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:19.201343 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9597f-b92f-409d-8eaa-2c18b3ae22a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:19.211802 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9597f-b92f-409d-8eaa-2c18b3ae22a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:19.213416 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9597f-b92f-409d-8eaa-2c18b3ae22a8 service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:19.222774 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1427/2883] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 11:00:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 11:00:23.140308 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ec6f7-2b2e-4590-ac3e-4dcd452d8428 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:23.147220 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-596ec6f7-2b2e-4590-ac3e-4dcd452d8428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:23.238903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ec6f7-2b2e-4590-ac3e-4dcd452d8428 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:23.238903 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:23.239766 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:23.240320 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:23.242855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] PATH_INFO: `/v3/users/8986355fdc9d45aab0dd19bc5aa5a0d4` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:23.242855 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8986355fdc9d45aab0dd19bc5aa5a0d4)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:23.246088 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:23.470575 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8986355fdc9d45aab0dd19bc5aa5a0d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:23.541504 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8986355fdc9d45aab0dd19bc5aa5a0d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:23.557775 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8986355fdc9d45aab0dd19bc5aa5a0d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:23.558541 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8986355fdc9d45aab0dd19bc5aa5a0d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:23.565511 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-3ebbde6d-869b-46a7-a3c1-5f4bdf01ca8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8986355fdc9d45aab0dd19bc5aa5a0d4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:23.571546 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1457/2884] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 11:00:23 2022] DELETE /identity/v3/users/8986355fdc9d45aab0dd19bc5aa5a0d4 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:00:23.822698 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9597f-b92f-409d-8eaa-2c18b3ae22a8 service swift] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:23.836266 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9597f-b92f-409d-8eaa-2c18b3ae22a8 service swift] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:23.909398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:23.910778 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:23.911228 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:23.911685 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] PATH_INFO: `/v3/projects/cca4d2fc958849c3ba49718889ac9562` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:23.913079 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca4d2fc958849c3ba49718889ac9562)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:23.915447 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:24.025459 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca4d2fc958849c3ba49718889ac9562', 'request_id': 'req-54c8ada5-5ace-41c0-9357-96ff40c5458a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:24.034048 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca4d2fc958849c3ba49718889ac9562', 'request_id': 'req-54c8ada5-5ace-41c0-9357-96ff40c5458a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:24.125000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca4d2fc958849c3ba49718889ac9562', 'request_id': 'req-54c8ada5-5ace-41c0-9357-96ff40c5458a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:24.138448 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] The token cache is being invalidate because project cca4d2fc958849c3ba49718889ac9562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 11:00:24.138740 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:24.139398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-54c8ada5-5ace-41c0-9357-96ff40c5458a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:24.141991 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1428/2885] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 11:00:23 2022] DELETE /identity/v3/projects/cca4d2fc958849c3ba49718889ac9562 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:00:24.146842 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d0977-fe1d-4124-ad8d-9e4cffcb7b34 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:24.147332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d0977-fe1d-4124-ad8d-9e4cffcb7b34 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:24.147460 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d0977-fe1d-4124-ad8d-9e4cffcb7b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:24.170049 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-9d4d0977-fe1d-4124-ad8d-9e4cffcb7b34 None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:00:24.171329 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9d4d0977-fe1d-4124-ad8d-9e4cffcb7b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:24.250836 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1458/2886] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 11:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 11:00:24.318940 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13d2f3-6ef2-4707-83b1-7ee46e0602de None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:24.319229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13d2f3-6ef2-4707-83b1-7ee46e0602de None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:24.319507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13d2f3-6ef2-4707-83b1-7ee46e0602de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:24.341507 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-bc13d2f3-6ef2-4707-83b1-7ee46e0602de None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:00:24.342853 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-bc13d2f3-6ef2-4707-83b1-7ee46e0602de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:24.355784 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d0977-fe1d-4124-ad8d-9e4cffcb7b34 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:24.356291 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1429/2887] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 11:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 11:00:24.368172 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d0977-fe1d-4124-ad8d-9e4cffcb7b34 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:24.372910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34883ad3-1a4c-4a1b-88c1-aa9f9d1a119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:24.373574 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34883ad3-1a4c-4a1b-88c1-aa9f9d1a119f admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:24.373856 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34883ad3-1a4c-4a1b-88c1-aa9f9d1a119f admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:24.374804 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34883ad3-1a4c-4a1b-88c1-aa9f9d1a119f admin admin] PATH_INFO: `/v3/domains` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:24.375615 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34883ad3-1a4c-4a1b-88c1-aa9f9d1a119f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 11:00:24.375930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34883ad3-1a4c-4a1b-88c1-aa9f9d1a119f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:24.377790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34883ad3-1a4c-4a1b-88c1-aa9f9d1a119f admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:24.389828 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:24.393994 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1459/2888] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jun 30 11:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 11:00:24.398270 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13d2f3-6ef2-4707-83b1-7ee46e0602de None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:24.409657 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13d2f3-6ef2-4707-83b1-7ee46e0602de None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:24.414587 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ff97f-e7a5-4547-8a70-182b898c6873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:24.415257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ff97f-e7a5-4547-8a70-182b898c6873 admin admin] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:24.415540 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ff97f-e7a5-4547-8a70-182b898c6873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:24.415817 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ff97f-e7a5-4547-8a70-182b898c6873 admin admin] PATH_INFO: `/v3/projects` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:24.416551 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ff97f-e7a5-4547-8a70-182b898c6873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:24.418579 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ff97f-e7a5-4547-8a70-182b898c6873 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:24.532129 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1430/2889] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jun 30 11:00:24 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 11:00:24.536296 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34883ad3-1a4c-4a1b-88c1-aa9f9d1a119f admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:24.556763 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34883ad3-1a4c-4a1b-88c1-aa9f9d1a119f admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:24.632276 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388a4d3-4cb9-46d8-9ff4-2a6ecc846cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:24.632886 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388a4d3-4cb9-46d8-9ff4-2a6ecc846cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:24.633177 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388a4d3-4cb9-46d8-9ff4-2a6ecc846cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:24.633466 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388a4d3-4cb9-46d8-9ff4-2a6ecc846cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:24.634210 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388a4d3-4cb9-46d8-9ff4-2a6ecc846cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:24.636218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388a4d3-4cb9-46d8-9ff4-2a6ecc846cb2 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:24.728130 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1460/2890] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jun 30 11:00:24 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 11:00:24.729359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ff97f-e7a5-4547-8a70-182b898c6873 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:24.741593 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ff97f-e7a5-4547-8a70-182b898c6873 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:24.746760 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd5148-5be7-4b7a-8e86-0ccc20c2242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:24.747530 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd5148-5be7-4b7a-8e86-0ccc20c2242f admin admin] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:24.747928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd5148-5be7-4b7a-8e86-0ccc20c2242f admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:24.748315 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd5148-5be7-4b7a-8e86-0ccc20c2242f admin admin] PATH_INFO: `/v3/roles` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:24.749175 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd5148-5be7-4b7a-8e86-0ccc20c2242f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:24.751451 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd5148-5be7-4b7a-8e86-0ccc20c2242f admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:24.767745 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1431/2891] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 11:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 11:00:24.769001 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388a4d3-4cb9-46d8-9ff4-2a6ecc846cb2 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:24.781846 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388a4d3-4cb9-46d8-9ff4-2a6ecc846cb2 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:24.787265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff119b28-e5c9-4a54-91f8-75395a5a10b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:24.787980 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff119b28-e5c9-4a54-91f8-75395a5a10b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:24.788285 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff119b28-e5c9-4a54-91f8-75395a5a10b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:24.788558 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff119b28-e5c9-4a54-91f8-75395a5a10b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:24.789306 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff119b28-e5c9-4a54-91f8-75395a5a10b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:24.791022 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff119b28-e5c9-4a54-91f8-75395a5a10b9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:24.806238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1461/2892] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jun 30 11:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 11:00:24.807586 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd5148-5be7-4b7a-8e86-0ccc20c2242f admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:24.817884 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd5148-5be7-4b7a-8e86-0ccc20c2242f admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:24.822656 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29847-e48a-4519-a67a-3877aab500fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:24.823673 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29847-e48a-4519-a67a-3877aab500fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:24.824224 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29847-e48a-4519-a67a-3877aab500fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:24.830258 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29847-e48a-4519-a67a-3877aab500fa admin admin] PATH_INFO: `/v3/projects/f448857cb0434ffd8a4d36f2b703e93d/users/7e390d22df7a4449b98604b39d2998a4/roles/217ceb9b91034918b3bb34c38120ab4f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:24.848063 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e29847-e48a-4519-a67a-3877aab500fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f448857cb0434ffd8a4d36f2b703e93d, user_id=7e390d22df7a4449b98604b39d2998a4, role_id=217ceb9b91034918b3bb34c38120ab4f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:24.851089 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e29847-e48a-4519-a67a-3877aab500fa admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:24.940093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1432/2893] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jun 30 11:00:24 2022] PUT /identity/v3/projects/f448857cb0434ffd8a4d36f2b703e93d/users/7e390d22df7a4449b98604b39d2998a4/roles/217ceb9b91034918b3bb34c38120ab4f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 11:00:24.950870 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db795be3-46b1-45eb-86c2-948082200b9d None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:24.951169 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db795be3-46b1-45eb-86c2-948082200b9d None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:24.951446 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db795be3-46b1-45eb-86c2-948082200b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:24.990114 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-db795be3-46b1-45eb-86c2-948082200b9d None None] MFA Rules not processed for user `7e390d22df7a4449b98604b39d2998a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:00:24.991643 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-db795be3-46b1-45eb-86c2-948082200b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:25.059238 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1462/2894] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 11:00:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 11:00:25.071178 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29847-e48a-4519-a67a-3877aab500fa admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:25.072964 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-65e29847-e48a-4519-a67a-3877aab500fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:25.083381 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:25.134362 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29847-e48a-4519-a67a-3877aab500fa admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:25.138317 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdc40a-920c-4293-b442-73f70ccb4916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19fd3da30bdb477e99dbbc2f7075f161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:25.138985 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdc40a-920c-4293-b442-73f70ccb4916 service cinder] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:25.139596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdc40a-920c-4293-b442-73f70ccb4916 service cinder] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:25.139596 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdc40a-920c-4293-b442-73f70ccb4916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:25.149418 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdc40a-920c-4293-b442-73f70ccb4916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:25.150943 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdc40a-920c-4293-b442-73f70ccb4916 service cinder] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:25.161193 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1433/2895] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:00:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:00:35.055925 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:35.205172 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=23 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:37.895164 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db795be3-46b1-45eb-86c2-948082200b9d None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:37.961228 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db795be3-46b1-45eb-86c2-948082200b9d None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:37.965727 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:37.966629 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:37.966920 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:37.967199 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] PATH_INFO: `/v3/users/7e390d22df7a4449b98604b39d2998a4` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:37.968697 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e390d22df7a4449b98604b39d2998a4)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:37.971205 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:38.154626 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e390d22df7a4449b98604b39d2998a4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:38.234449 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e390d22df7a4449b98604b39d2998a4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:38.247131 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e390d22df7a4449b98604b39d2998a4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:38.247779 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e390d22df7a4449b98604b39d2998a4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:38.255462 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e390d22df7a4449b98604b39d2998a4'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:38.261434 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1463/2896] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 11:00:37 2022] DELETE /identity/v3/users/7e390d22df7a4449b98604b39d2998a4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:00:38.265900 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f204f7-9938-438b-aadd-c46cf16c43ad None None] REQUEST_METHOD: `POST` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:38.266389 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f204f7-9938-438b-aadd-c46cf16c43ad None None] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:38.266504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f204f7-9938-438b-aadd-c46cf16c43ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:38.284452 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.auth.core [None req-b8f204f7-9938-438b-aadd-c46cf16c43ad None None] MFA Rules not processed for user `2c6c1fd699164758801d4c68c84f57b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:00:38.285690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b8f204f7-9938-438b-aadd-c46cf16c43ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:38.346263 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1434/2897] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jun 30 11:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 11:00:38.356261 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:38.357821 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:38.417269 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b4921-415b-493a-a16f-81e4649d79d9 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:38.420815 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b944b2-63e8-4b49-ae1e-cf1fbe860f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:38.421610 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b944b2-63e8-4b49-ae1e-cf1fbe860f35 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:38.421900 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b944b2-63e8-4b49-ae1e-cf1fbe860f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:38.422213 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b944b2-63e8-4b49-ae1e-cf1fbe860f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:38.433080 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b944b2-63e8-4b49-ae1e-cf1fbe860f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:38.434617 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b944b2-63e8-4b49-ae1e-cf1fbe860f35 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:38.444398 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1464/2898] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:00:38.862647 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f204f7-9938-438b-aadd-c46cf16c43ad None None] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:38.864101 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-b8f204f7-9938-438b-aadd-c46cf16c43ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:38.879790 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f204f7-9938-438b-aadd-c46cf16c43ad None None] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:38.885440 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:38.887901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:38.887901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:38.887901 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] PATH_INFO: `/v3/projects/f448857cb0434ffd8a4d36f2b703e93d` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:38.889494 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f448857cb0434ffd8a4d36f2b703e93d)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:38.891504 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:39.021359 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f448857cb0434ffd8a4d36f2b703e93d', 'request_id': 'req-ea2e7c84-9b61-4234-86f9-434dde277039'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:39.027490 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f448857cb0434ffd8a4d36f2b703e93d', 'request_id': 'req-ea2e7c84-9b61-4234-86f9-434dde277039'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:39.114617 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f448857cb0434ffd8a4d36f2b703e93d', 'request_id': 'req-ea2e7c84-9b61-4234-86f9-434dde277039'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:39.125492 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] The token cache is being invalidate because project f448857cb0434ffd8a4d36f2b703e93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 11:00:39.125775 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:39.126917 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:00:39.128446 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1435/2899] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 11:00:38 2022] DELETE /identity/v3/projects/f448857cb0434ffd8a4d36f2b703e93d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:00:42.138470 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b944b2-63e8-4b49-ae1e-cf1fbe860f35 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:42.139949 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-96b944b2-63e8-4b49-ae1e-cf1fbe860f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:42.151271 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b944b2-63e8-4b49-ae1e-cf1fbe860f35 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:42.169636 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:42.199751 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:42.200386 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:42.200668 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:42.200942 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:42.202705 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:42.265914 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:42.268892 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:42.280992 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1465/2900] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:00:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:00:47.061335 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:47.063538 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:47.185518 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e7c84-9b61-4234-86f9-434dde277039 admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:47.194334 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:47.195295 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:47.195815 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:47.196300 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:47.199302 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:47.224509 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:47.226257 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:47.242846 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1436/2901] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:00:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:00:52.285757 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=40 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:57.234130 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:01:12.893605 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:01:12.896732 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:01:12.908650 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338a732-a721-4c6d-aa4d-cae44954e291 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:01:12.913508 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac6e11-be34-4720-90ca-382d78fcae52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:01:12.914202 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac6e11-be34-4720-90ca-382d78fcae52 service neutron] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:01:12.914489 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac6e11-be34-4720-90ca-382d78fcae52 service neutron] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:01:12.914768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac6e11-be34-4720-90ca-382d78fcae52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:01:12.916573 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-0cac6e11-be34-4720-90ca-382d78fcae52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:01:12.931768 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac6e11-be34-4720-90ca-382d78fcae52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:01:12.933218 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac6e11-be34-4720-90ca-382d78fcae52 service neutron] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:01:12.952847 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1466/2902] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:01:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:01:14.242871 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:01:14.244269 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:01:14.256087 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc26c1c-092d-4bd2-93e4-05fa0726edef service nova] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:01:14.259684 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f09ae3-a43e-4f10-ba88-c3a8907a3e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:01:14.260320 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f09ae3-a43e-4f10-ba88-c3a8907a3e14 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:01:14.260611 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f09ae3-a43e-4f10-ba88-c3a8907a3e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:01:14.260894 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f09ae3-a43e-4f10-ba88-c3a8907a3e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:01:14.262618 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-22f09ae3-a43e-4f10-ba88-c3a8907a3e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:01:14.276608 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f09ae3-a43e-4f10-ba88-c3a8907a3e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:01:14.278150 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f09ae3-a43e-4f10-ba88-c3a8907a3e14 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:01:14.289128 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1437/2903] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:01:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:01:22.948227 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=6 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:01:24.284330 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=6 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:01:59.158383 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac6e11-be34-4720-90ca-382d78fcae52 service neutron] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:01:59.176309 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac6e11-be34-4720-90ca-382d78fcae52 service neutron] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:01:59.199879 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d6267-7d32-4b67-a3de-ee6f0af4aff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f46cf6eb4a44a71bda92cb212a8009c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:01:59.200635 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6267-7d32-4b67-a3de-ee6f0af4aff7 service nova] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:01:59.200985 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6267-7d32-4b67-a3de-ee6f0af4aff7 service nova] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:01:59.201756 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6267-7d32-4b67-a3de-ee6f0af4aff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:01:59.203930 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-a48d6267-7d32-4b67-a3de-ee6f0af4aff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:01:59.222332 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6267-7d32-4b67-a3de-ee6f0af4aff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:01:59.224096 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6267-7d32-4b67-a3de-ee6f0af4aff7 service nova] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:01:59.240307 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1467/2904] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:01:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:01:59.325229 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f09ae3-a43e-4f10-ba88-c3a8907a3e14 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:01:59.336431 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f09ae3-a43e-4f10-ba88-c3a8907a3e14 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:01:59.340323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719afb6dcb154119beb18d2f1974fe2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:01:59.341040 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:01:59.341323 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:01:59.341832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:01:59.344000 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:01:59.357883 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:01:59.359375 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:01:59.372873 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1438/2905] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:01:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:02:08.218525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a515f-f31a-4131-8a36-2f9f57768a29 None None] REQUEST_METHOD: `POST` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:02:08.219224 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a515f-f31a-4131-8a36-2f9f57768a29 None None] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:02:08.219437 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a515f-f31a-4131-8a36-2f9f57768a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:02:08.237183 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.auth.core [None req-419a515f-f31a-4131-8a36-2f9f57768a29 None None] MFA Rules not processed for user `25df9d4438a34863bbde92da4be8c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:02:08.238429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-419a515f-f31a-4131-8a36-2f9f57768a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:02:08.292790 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1468/2906] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jun 30 11:02:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 11:02:08.332453 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:02:08.333881 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:02:08.404929 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c1255-ca09-41e6-b0a4-7d5246234994 service neutron] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:02:08.409990 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adadd6b-3230-496b-b572-b559d8f7d861 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f93427bde8154d509bc67675b03903db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:02:08.410640 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adadd6b-3230-496b-b572-b559d8f7d861 service swift] REQUEST_METHOD: `GET` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:02:08.410928 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adadd6b-3230-496b-b572-b559d8f7d861 service swift] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:02:08.411236 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adadd6b-3230-496b-b572-b559d8f7d861 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:02:08.420188 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adadd6b-3230-496b-b572-b559d8f7d861 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:02:08.421779 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adadd6b-3230-496b-b572-b559d8f7d861 service swift] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:02:08.430093 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1439/2907] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jun 30 11:02:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 11:02:16.486268 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a515f-f31a-4131-8a36-2f9f57768a29 None None] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:02:16.487926 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-419a515f-f31a-4131-8a36-2f9f57768a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:02:16.554525 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a515f-f31a-4131-8a36-2f9f57768a29 None None] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:02:16.559107 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:02:16.559975 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:02:16.560266 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:02:16.560544 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] PATH_INFO: `/v3/users/448bf0ab9e98421588f376fcf371fdf6` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:02:16.561748 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448bf0ab9e98421588f376fcf371fdf6)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:02:16.563762 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:02:16.799894 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448bf0ab9e98421588f376fcf371fdf6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:16.881312 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448bf0ab9e98421588f376fcf371fdf6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:16.894357 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448bf0ab9e98421588f376fcf371fdf6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:16.894910 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448bf0ab9e98421588f376fcf371fdf6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:16.902540 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448bf0ab9e98421588f376fcf371fdf6'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:16.908584 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1469/2908] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 11:02:16 2022] DELETE /identity/v3/users/448bf0ab9e98421588f376fcf371fdf6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:02:17.163364 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adadd6b-3230-496b-b572-b559d8f7d861 service swift] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:02:17.175253 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adadd6b-3230-496b-b572-b559d8f7d861 service swift] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:02:17.239471 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:02:17.240325 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:02:17.240683 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:02:17.240948 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] PATH_INFO: `/v3/projects/a8fa709f09cf47e68b16ddc2896a6b1f` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:02:17.242661 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8fa709f09cf47e68b16ddc2896a6b1f)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:02:17.246746 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:02:17.353065 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8fa709f09cf47e68b16ddc2896a6b1f', 'request_id': 'req-2e535d6c-5aa6-469d-8887-3d248f46aa9a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.359204 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8fa709f09cf47e68b16ddc2896a6b1f', 'request_id': 'req-2e535d6c-5aa6-469d-8887-3d248f46aa9a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.424749 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8fa709f09cf47e68b16ddc2896a6b1f', 'request_id': 'req-2e535d6c-5aa6-469d-8887-3d248f46aa9a'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.435957 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] The token cache is being invalidate because project a8fa709f09cf47e68b16ddc2896a6b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 11:02:17.436247 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.436859 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.438435 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1440/2909] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 11:02:17 2022] DELETE /identity/v3/projects/a8fa709f09cf47e68b16ddc2896a6b1f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:02:17.442384 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:02:17.444009 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:02:17.457110 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998336d-fa2a-4b10-becb-c643b1282672 admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:02:17.465157 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:02:17.514543 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:02:17.515417 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:02:17.515706 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:02:17.515988 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] PATH_INFO: `/v3/users/a1599cc669e841afa147c0e2aee17c91` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:02:17.517175 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1599cc669e841afa147c0e2aee17c91)` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:02:17.519536 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:02:17.657124 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1599cc669e841afa147c0e2aee17c91'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.728216 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1599cc669e841afa147c0e2aee17c91'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.740639 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1599cc669e841afa147c0e2aee17c91'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.741265 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1599cc669e841afa147c0e2aee17c91'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.748034 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.notifications [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1599cc669e841afa147c0e2aee17c91'} {{(pid=86804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:17.753803 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1470/2910] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jun 30 11:02:17 2022] DELETE /identity/v3/users/a1599cc669e841afa147c0e2aee17c91 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:02:18.035041 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] Authenticating user token {{(pid=86803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:02:18.044133 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.fernet_utils [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:02:18.049882 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e535d6c-5aa6-469d-8887-3d248f46aa9a admin admin] Validating token access rules against request {{(pid=86803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:02:18.053832 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:02:18.108877 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6c1fd699164758801d4c68c84f57b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50d0b85329f04f0dbf62de05b9135235', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:02:18.109734 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:02:18.110050 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:02:18.110331 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] PATH_INFO: `/v3/projects/3c33d632ae7b4bbcbea42a72686cb8be` {{(pid=86803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:02:18.111710 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c33d632ae7b4bbcbea42a72686cb8be)` {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:02:18.113623 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] RBAC: Authorization granted {{(pid=86803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:02:18.231273 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c33d632ae7b4bbcbea42a72686cb8be', 'request_id': 'req-79910382-2ef5-4176-bcda-3e62710f2882'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:18.237524 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c33d632ae7b4bbcbea42a72686cb8be', 'request_id': 'req-79910382-2ef5-4176-bcda-3e62710f2882'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:18.304347 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c33d632ae7b4bbcbea42a72686cb8be', 'request_id': 'req-79910382-2ef5-4176-bcda-3e62710f2882'} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:18.315398 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] The token cache is being invalidate because project 3c33d632ae7b4bbcbea42a72686cb8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 11:02:18.315690 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:18.316310 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG keystone.notifications [None req-79910382-2ef5-4176-bcda-3e62710f2882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:02:18.317856 dv-cinder-822822-2-smb devstack@keystone.service[86803]: [pid: 86803|app: 0|req: 1441/2911] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jun 30 11:02:18 2022] DELETE /identity/v3/projects/3c33d632ae7b4bbcbea42a72686cb8be => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:02:27.750345 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:02:28.312316 dv-cinder-822822-2-smb devstack@keystone.service[86803]: DEBUG dbcounter [-] [86803] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:04:16.617294 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] Authenticating user token {{(pid=86804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:04:16.618787 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:04:16.756623 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd006-c1e7-4d8c-8d0b-c78e6e7b2c0e admin admin] Validating token access rules against request {{(pid=86804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:04:16.813749 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600953a3-d7aa-4012-bf12-5e12ffcc0a2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3238a52a3f6047e0acb0136ab39257e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4056fccf08430b87e2e8cf1aa1c60f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:04:16.814429 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600953a3-d7aa-4012-bf12-5e12ffcc0a2d service placement] REQUEST_METHOD: `GET` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:04:16.814719 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600953a3-d7aa-4012-bf12-5e12ffcc0a2d service placement] SCRIPT_NAME: `/identity` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:04:16.815003 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600953a3-d7aa-4012-bf12-5e12ffcc0a2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:04:16.816772 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.fernet_utils [None req-600953a3-d7aa-4012-bf12-5e12ffcc0a2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:04:16.828557 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600953a3-d7aa-4012-bf12-5e12ffcc0a2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:04:16.830160 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600953a3-d7aa-4012-bf12-5e12ffcc0a2d service placement] RBAC: Authorization granted {{(pid=86804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:04:16.840496 dv-cinder-822822-2-smb devstack@keystone.service[86804]: [pid: 86804|app: 0|req: 1471/2912] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jun 30 11:04:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:04:26.835726 dv-cinder-822822-2-smb devstack@keystone.service[86804]: DEBUG dbcounter [-] [86804] Writing DB stats keystone:SELECT=89 {{(pid=86804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}